00000001:02000400:0.0F:1788929696.113515:0:2963:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788929715.450437:0:3184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788929717.272787:0:3228:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 673 MB/s 00000001:01000000:0.0:1788929717.523066:0:3228:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 551 MB/s 00000001:01000000:2.0:1788929717.772968:0:3228:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2295 MB/s 00000020:02000000:2.0:1788929718.887452:0:3276:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_gf1a8369 00000400:02000000:3.0F:1788929720.039604:0:3292:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.140@tcp [8/256/0/180] 00008000:02000000:2.0:1788929723.914642:0:3441:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788929777.577440:0:5246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788929786.089713:0:5820:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788929786.089722:0:5820:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788929786.090661:0:5820:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000001680689b 00000080:02000400:2.0:1788929786.090679:0:5820:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788929786.099597:0:5820:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788929786.099613:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788929786.099655:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009054bc3b) 00000020:00000080:2.0:1788929786.099675:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788929786.140431:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788929786.142164:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788929786.191532:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788929786.192169:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788929786.192198:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788929786.192290:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788929786.192317:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788929786.193169:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788929786.193178:0:5820:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788929786.193189:0:5820:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237c5c8 00000020:01000004:2.0:1788929786.193196:0:5820:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788929786.193202:0:5820:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788929786.193206:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001680689b from MGS 00000020:01000004:2.0:1788929786.193211:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788929786.193219:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000002e7f3117) 00000020:00000080:2.0:1788929786.193255:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788929786.194529:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001680689b from MGS, refs=2 00080000:01000000:2.0:1788929786.194543:0:5820:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788929786.194551:0:5820:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237c5d6 00000100:00100000:2.0:1788929786.195525:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788929786.196404:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788929786.196413:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788929786.200407:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788929786.200427:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788929786.201331:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788929786.201531:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788929786.201537:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788929786.202448:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788929786.202456:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788929786.202959:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788929786.202966:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0F:1788929786.207952:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929786.207963:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929786.207965:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929786.221110:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929786.221119:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929786.221121:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929786.225015:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788929786.234482:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788929786.471282:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4919 MB/s 00000001:01000000:2.0:1788929786.721729:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3887 MB/s 00000001:01000000:0.0:1788929786.972111:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 395 MB/s 00000001:01000000:3.0:1788929787.223862:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 591 MB/s 00080000:10000000:2.0:1788929787.247927:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1788929787.274474:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788929787.274492:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788929787.274494:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788929787.275126:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788929787.275171:0:5820:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788929787.275202:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788929787.275444:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788929787.275470:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788929787.275774:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788929787.275925:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788929787.275931:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788929787.278378:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788929787.278394:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788929787.281137:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788929787.281149:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788929787.281774:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788929787.281794:0:5820:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.140@tcp' 00000020:01000004:0.0:1788929787.281796:0:5820:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788929787.281849:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.140@tcp (typ=mgc) 00000020:00000080:0.0:1788929787.281884:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.140@tcp (0000000070f593ff) 00000020:00000080:0.0:1788929787.281903:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788929787.282006:0:5820:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ddfdbce2@MGC192.168.204.140@tcp: add connection 192.168.204.140@tcp at head 00010000:00010000:0.0:1788929787.282166:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.140@tcp-0 is initialized 00000040:01000000:0.0:1788929787.282173:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788929787.286194:0:5835:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788929787.289938:0:5837:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788929787.290038:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.140@tcp (uuid bddba76f-ee04-4b28-985b-cc9b0811bff7) 00000020:00000080:2.0:1788929787.290061:0:5820:0:(genops.c:1384:class_connect()) connect: client bddba76f-ee04-4b28-985b-cc9b0811bff7, cookie 0xce4472dd2237c5e4 00000100:00080000:2.0:1788929787.290074:0:5820:0:(import.c:545:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788929787.290083:0:5820:0:(import.c:666:import_select_connection()) MGC192.168.204.140@tcp: import 00000000ddfdbce2 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1788929787.290128:0:5820:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009f458f54 x1875828770078848/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788929787.290156:0:5820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bddba76f-ee04-4b28-985b-cc9b0811bff7->MGS 00000020:01000004:2.0:1788929787.290185:0:5820:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788929787.290191:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788929787.290204:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a96e0272) 00000020:00000080:2.0:1788929787.290214:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788929787.290513:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f458f54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bddba76f-ee04-4b28-985b-cc9b0811bff7:3307:1875828770078848:0@lo:250: 00000100:00100000:3.0:1788929787.290612:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929787.291309:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770078848 00000100:00100000:1.0:1788929787.291318:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770078848 00000100:00100000:1.0:1788929787.291362:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788929787.291368:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012b8ddaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1875828770078848:12345-0@lo:250: 00010000:00080000:1.0:1788929787.291392:0:5831:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from bddba76f-ee04-4b28-985b-cc9b0811bff7@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:1.0:1788929787.291413:0:5831:0:(genops.c:1384:class_connect()) connect: client bddba76f-ee04-4b28-985b-cc9b0811bff7, cookie 0xce4472dd2237c5f2 00000100:00080000:1.0:1788929787.291546:0:5831:0:(import.c:65:import_set_state_nolock()) 000000008b52ca8e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788929787.291613:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012b8ddaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+5:3307:x1875828770078848:12345-0@lo:250: Request processed in 244us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929787.291621:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788929787.291669:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788929787.291679:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.140@tcp: connect to target with instance 0 00000100:00080000:1.0:1788929787.291689:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788929787.291693:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788929787.291696:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000ddfdbce2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788929787.291699:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788929787.291709:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788929787.291712:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f458f54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bddba76f-ee04-4b28-985b-cc9b0811bff7:3307:1875828770078848:0@lo:250: 00010000:00010000:3.0:1788929787.295213:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929787.302514:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788929787.302703:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788929787.302710:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788929787.309065:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788929787.309083:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788929787.309479:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788929787.309494:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788929787.310190:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788929787.310441:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788929787.310446:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788929787.312459:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788929787.312470:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788929787.366563:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788929787.369365:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788929787.369377:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788929787.370667:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788929787.370687:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788929787.371623:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788929787.371896:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788929787.371903:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788929787.373435:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788929787.373445:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788929787.374081:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788929787.374411:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788929787.374417:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788929787.377566:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788929787.377582:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788929787.378262:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788929787.378444:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788929787.378449:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788929787.381855:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788929787.381881:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788929787.412216:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788929787.412577:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788929787.412583:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788929787.415794:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788929787.415813:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788929787.417380:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788929787.417392:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788929787.419573:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788929787.419599:0:5820:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788929787.419604:0:5820:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788929787.420002:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788929787.420046:0:5820:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.140@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788929787.420051:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788929787.420053:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788929787.420054:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788929787.420056:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788929787.420057:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788929787.420058:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788929787.420059:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788929787.420060:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788929787.420063:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788929787.420064:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788929787.420065:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788929787.420067:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788929787.420069:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788929787.420071:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788929787.420072:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788929787.420073:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788929787.420074:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788929787.420075:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788929787.420076:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788929787.420077:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788929787.420078:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788929787.420079:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788929787.420080:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788929787.420081:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788929787.420088:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788929787.420189:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788929787.420206:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ece70c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770078976:0@lo:253: 00000100:00100000:0.0:1788929787.420407:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929787.420505:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000690afece going to sleep for 11 seconds 00000100:00100000:3.0:1788929787.420605:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770078976 00000100:00100000:3.0:1788929787.420613:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770078976 00000100:00100000:3.0:1788929787.420776:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788929787.420785:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dd1e7a94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+5:5820:x1875828770078976:12345-0@lo:253: 20000000:01000000:3.0:1788929787.420826:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788929787.420829:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788929787.421877:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788929787.421987:0:5834:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788929787.422316:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788929787.426044:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788929787.426423:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788929787.426428:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788929787.426435:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788929787.426438:0:5834:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788929787.426454:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788929787.426765:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788929787.427007:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788929787.427018:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788929787.427065:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788929787.427124:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788929787.427163:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788929787.427265:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788929787.427279:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788929787.427323:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788929787.427330:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788929787.427358:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788929787.427365:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788929787.427392:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788929787.427437:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788929787.427467:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788929787.427472:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788929787.427485:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788929787.427702:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788929787.427711:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788929787.427742:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788929787.427770:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788929787.427809:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788929787.427820:0:5834:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788929787.427895:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788929787.427903:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788929787.427939:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788929787.427971:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788929787.428001:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788929787.428010:0:5834:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788929787.428086:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788929787.428095:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788929787.428125:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788929787.428161:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788929787.428320:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788929787.428358:0:5834:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788929787.428364:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788929787.433654:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788929787.434303:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788929787.434333:0:5834:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.140@tcp for mdt 20000000:01000000:3.0:1788929787.434335:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.140@tcp (null) (null) (null) 00000040:00080000:3.0:1788929787.434385:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788929787.434394:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788929787.434426:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788929787.434433:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.140@tcp (null) (null) 00000040:00080000:3.0:1788929787.434478:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788929787.434489:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788929787.434521:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788929787.434574:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788929787.434634:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788929787.434637:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788929787.434644:0:5834:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788929787.434650:0:5834:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788929787.435571:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1788929787.435701:0:5834:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788929787.442904:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788929787.442960:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1788929787.443053:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1788929787.443070:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788929787.443073:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788929787.443077:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788929787.443089:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788929787.443091:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788929787.443133:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788929787.443135:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788929787.443945:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1788929787.444213:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1788929787.444282:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1788929787.444367:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1788929787.444379:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788929787.444381:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788929787.445034:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788929787.445284:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788929787.445339:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788929787.445372:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788929787.445384:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788929787.445386:0:5834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1788929787.445393:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788929787.445415:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000643485d1/0xce4472dd2237c5f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.445433:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000643485d1/0xce4472dd2237c5f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.445445:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000643485d1/0xce4472dd2237c5f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.445452:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000643485d1/0xce4472dd2237c5f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.445459:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000643485d1/0xce4472dd2237c5f9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.445466:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000643485d1/0xce4472dd2237c5f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.445481:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000643485d1 already unused, calling callback (000000000a507a08) 00010000:00010000:0.0:1788929787.445485:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000643485d1/0xce4472dd2237c5f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.445493:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000643485d1/0xce4472dd2237c5f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.445508:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000643485d1/0xce4472dd2237c5f9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.445516:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000643485d1/0xce4472dd2237c5f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.445522:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000643485d1/0xce4472dd2237c5f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788929787.445541:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788929787.680556:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dd1e7a94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+5:5820:x1875828770078976:12345-0@lo:253: Request processed in 259766us (260143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929787.680574:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788929787.680671:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ece70c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770078976:0@lo:253: 10000000:01000000:1.0:1788929787.680686:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788929787.680689:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788929787.680691:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788929787.680693:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788929787.680694:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788929787.680695:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788929787.680696:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788929787.680697:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788929787.680698:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788929787.680699:0:5820:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788929787.680701:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788929787.680702:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788929787.680718:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001680689b from lustre-MDT0000 10000000:01000000:1.0:1788929787.680744:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788929787.680747:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788929787.680752:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d2e8637b380 10000000:01000000:1.0:1788929787.680758:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788929787.680765:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2e8637b380 from 1 10000000:01000000:1.0:1788929787.680780:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788929787.680827:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929787.680837:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929787.680846:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929787.680874:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7b60743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770079104:0@lo:101: 00000100:00100000:1.0:1788929787.680908:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929787.680998:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a4fc86f4 going to sleep for 11 seconds 00000100:00100000:2.0:1788929787.681116:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770079104 00000100:00100000:2.0:1788929787.681123:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770079104 00000100:00100000:2.0:1788929787.681204:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788929787.681214:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c67716f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+5:5820:x1875828770079104:12345-0@lo:101: 00010000:00010000:2.0:1788929787.681251:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929787.681265:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009c448e87/0xce4472dd2237c607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c600 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929787.681287:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009c448e87/0xce4472dd2237c607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c600 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929787.681297:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009c448e87/0xce4472dd2237c607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c600 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929787.681315:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009c448e87, rc 0) 00000100:00100000:2.0:1788929787.681346:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c67716f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+6:5820:x1875828770079104:12345-0@lo:101: Request processed in 135us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929787.681352:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788929787.681413:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7b60743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770079104:0@lo:101: 00010000:00010000:0.0:1788929787.681424:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c607 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.681432:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c607 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929787.681474:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770079232:0@lo:501: 00000100:00100000:0.0:1788929787.681516:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929787.681697:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e7ecaf6 going to sleep for 11 seconds 00000100:00100000:1.0:1788929787.681768:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770079232 00000100:00100000:1.0:1788929787.681773:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770079232 00000100:00100000:1.0:1788929787.681793:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788929787.681798:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e9e3fe8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+6:5820:x1875828770079232:12345-0@lo:501: 00000100:00100000:1.0:1788929787.682013:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e9e3fe8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+6:5820:x1875828770079232:12345-0@lo:501: Request processed in 214us (496us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788929787.682020:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788929787.682091:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770079232:0@lo:501: 10000000:01000000:0.0:1788929787.682116:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788929787.682132:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c607 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.682140:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c607 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929787.682147:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2e86b99000 10000000:01000000:0.0:1788929787.682150:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788929787.682154:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d2e86b99000 10000000:01000000:0.0:1788929787.682157:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788929787.682160:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d2e86b99000 from 1 10000000:01000000:0.0:1788929787.682162:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788929787.682178:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: 00000000643485d1/0xce4472dd2237c60e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.682184:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: 00000000643485d1/0xce4472dd2237c60e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.682191:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: 00000000643485d1/0xce4472dd2237c60e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929787.682202:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770079360:0@lo:101: 00000100:00100000:0.0:1788929787.682244:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929787.682255:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e7ecaf6 going to sleep for 11 seconds 00000100:00100000:1.0:1788929787.682377:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770079360 00000100:00100000:1.0:1788929787.682382:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770079360 00000100:00100000:1.0:1788929787.682401:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788929787.682407:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b53b30ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+6:5820:x1875828770079360:12345-0@lo:101: 00010000:00010000:1.0:1788929787.682414:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929787.682425:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c90c8131/0xce4472dd2237c615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c60e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929787.682440:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c90c8131/0xce4472dd2237c615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c60e expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929787.682457:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c90c8131/0xce4472dd2237c615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c60e expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929787.682464:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c90c8131, rc 0) 00000100:00100000:1.0:1788929787.682500:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b53b30ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+7:5820:x1875828770079360:12345-0@lo:101: Request processed in 93us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929787.682506:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788929787.682587:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770079360:0@lo:101: 00010000:00010000:0.0:1788929787.682606:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: 00000000643485d1/0xce4472dd2237c60e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.682614:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: 00000000643485d1/0xce4472dd2237c60e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929787.682624:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788929787.682638:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: 00000000643485d1/0xce4472dd2237c60e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.682644:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: 00000000643485d1/0xce4472dd2237c60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929787.682649:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788929787.682652:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788929787.682656:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d2e86b99000 10000000:01000000:0.0:1788929787.682658:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788929787.682660:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788929787.682662:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788929787.682673:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.682679:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.682684:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929787.682694:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770079488:0@lo:101: 00000100:00100000:0.0:1788929787.682717:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929787.682741:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e7ecaf6 going to sleep for 11 seconds 00000100:00100000:1.0:1788929787.682989:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770079488 00000100:00100000:1.0:1788929787.682993:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770079488 00000100:00100000:1.0:1788929787.683011:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788929787.683016:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000023767bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+7:5820:x1875828770079488:12345-0@lo:101: 00010000:00010000:1.0:1788929787.683022:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929787.683028:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c4fe51f0/0xce4472dd2237c623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c61c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929787.683041:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4fe51f0/0xce4472dd2237c623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c61c expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929787.683048:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c4fe51f0/0xce4472dd2237c623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c61c expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929787.683054:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c4fe51f0, rc 0) 00000100:00100000:1.0:1788929787.683090:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000023767bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+8:5820:x1875828770079488:12345-0@lo:101: Request processed in 74us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929787.683096:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788929787.683162:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770079488:0@lo:101: 00010000:00010000:0.0:1788929787.683171:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c623 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929787.683177:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c623 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929787.683211:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770079616:0@lo:501: 00000100:00100000:0.0:1788929787.683262:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929787.683273:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e7ecaf6 going to sleep for 11 seconds 00000100:00100000:1.0:1788929787.683383:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770079616 00000100:00100000:1.0:1788929787.683388:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770079616 00000100:00100000:1.0:1788929787.683405:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788929787.683417:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a2427128 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+8:5820:x1875828770079616:12345-0@lo:501: 00000100:00100000:1.0:1788929787.683595:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a2427128 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+9:5820:x1875828770079616:12345-0@lo:501: Request processed in 178us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929787.683601:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788929787.683675:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770079616:0@lo:501: 00000100:00100000:0.0:1788929787.683700:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770079744:0@lo:503: 00000100:00100000:0.0:1788929787.683735:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929787.683761:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e7ecaf6 going to sleep for 11 seconds 00000100:00100000:1.0:1788929787.683813:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770079744 00000100:00100000:1.0:1788929787.683817:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770079744 00000100:00100000:1.0:1788929787.683834:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788929787.683839:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007a9fe4df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+9:5820:x1875828770079744:12345-0@lo:503: 00000100:00100000:1.0:1788929787.684031:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007a9fe4df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+9:5820:x1875828770079744:12345-0@lo:503: Request processed in 192us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929787.684038:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788929787.684387:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770079744:0@lo:503: 00000100:00100000:3.0:1788929787.684705:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f829f0b5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:5862:1875828770079872:0@lo:502: 00000100:00100000:3.0:1788929787.684741:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929787.684805:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fa455502 going to sleep for 11 seconds 00000100:00100000:1.0:1788929787.684840:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770079872 00000100:00100000:1.0:1788929787.684845:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770079872 00000100:00100000:1.0:1788929787.684919:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788929787.684925:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000236f08d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+9:5862:x1875828770079872:12345-0@lo:502: 00000100:00100000:1.0:1788929787.685079:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000236f08d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+9:5862:x1875828770079872:12345-0@lo:502: Request processed in 155us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929787.685086:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788929787.685151:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f829f0b5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:5862:1875828770079872:0@lo:502: 00000020:01000000:3.0:1788929787.685172:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788929787.685181:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929787.685183:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788929787.685188:0:5862:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788929787.685190:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788929787.685209:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000049d2f25c) 00000020:00000080:3.0:1788929787.685253:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788929787.685260:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788929787.685338:0:5862:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788929787.685349:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237c631 00000020:00000080:3.0:1788929787.685581:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788929787.685587:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788929787.685590:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929787.685592:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788929787.685594:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788929787.685597:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929787.685598:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788929787.685601:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788929787.685607:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f1a655e5) 00000020:00000080:3.0:1788929787.685616:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788929787.685620:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788929787.685622:0:5862:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788929787.685624:0:5862:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788929787.685630:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788929787.685673:0:5862:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001680689b from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788929787.685683:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ede52d3c) 00000020:00000080:3.0:1788929787.685691:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788929787.685759:0:5862:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788929787.685764:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237c646 00000020:00000080:3.0:1788929787.685849:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788929787.685866:0:5862:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788929787.685871:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xce4472dd2237c64d 00080000:01000000:3.0:1788929787.685876:0:5862:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788929787.685879:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237c654 00080000:10000000:3.0:1788929787.686275:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788929787.686476:0:5862:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788929787.691190:0:5862:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788929787.767898:0:5862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788929787.768670:0:5862:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788929787.771645:0:5862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788929787.772076:0:5862:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788929787.804582:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000039951560) 00000020:00000080:1.0:1788929787.804610:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788929787.804724:0:5862:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788929787.804732:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237c662 00000020:00000080:2.0:1788929787.806736:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788929787.807989:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788929787.862991:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788929787.900563:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788929787.934916:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788929787.976516:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788929788.010457:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788929788.040154:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xce4472dd2237c669 00000020:00000080:1.0:1788929788.040447:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788929788.040460:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788929788.040465:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788929788.040468:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788929788.040470:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788929788.040482:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788929788.040484:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788929788.040487:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788929788.040521:0:5862:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788929788.040533:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788929788.040535:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788929788.040536:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788929788.040538:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788929788.040540:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788929788.040541:0:5862:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788929788.040544:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788929788.040545:0:5862:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788929788.040719:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023670d72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:5862:1875828770080000:0@lo:502: 00000100:00100000:1.0:1788929788.040799:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929788.040846:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc54881d going to sleep for 11 seconds 00000100:00100000:1.0:1788929788.040882:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770080000 00000100:00100000:1.0:1788929788.040889:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770080000 00000100:00100000:1.0:1788929788.040930:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788929788.040937:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014341038 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+9:5862:x1875828770080000:12345-0@lo:502: 00000100:00100000:1.0:1788929788.042352:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014341038 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+9:5862:x1875828770080000:12345-0@lo:502: Request processed in 1409us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929788.042364:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788929788.043811:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023670d72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:5862:1875828770080000:0@lo:502: 00000020:01000000:2.0:1788929788.043877:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788929788.043885:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788929788.043888:0:5862:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788929788.043893:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788929788.044058:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788929788.044081:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788929788.044100:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c623 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929788.044111:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c623 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929788.044130:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2e86b99000 from 1 10000000:01000000:0.0:1788929788.044133:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788929788.044174:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929788.044181:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929788.044189:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929788.044208:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080128:0@lo:101: 00000100:00100000:0.0:1788929788.044278:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929788.044327:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dca49233 going to sleep for 11 seconds 00000100:00100000:1.0:1788929788.044457:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770080128 00000100:00100000:1.0:1788929788.044464:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770080128 00000100:00100000:1.0:1788929788.044512:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788929788.044521:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c14ce80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+9:5820:x1875828770080128:12345-0@lo:101: 00010000:00010000:1.0:1788929788.044533:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929788.044546:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000209f159b/0xce4472dd2237c677 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c670 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929788.044649:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000209f159b/0xce4472dd2237c677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c670 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929788.044662:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000209f159b/0xce4472dd2237c677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c670 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929788.044670:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000209f159b, rc 0) 00000100:00100000:1.0:1788929788.044706:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c14ce80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+10:5820:x1875828770080128:12345-0@lo:101: Request processed in 188us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929788.044712:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788929788.044937:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080128:0@lo:101: 00010000:00010000:0.0:1788929788.044951:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c677 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929788.044970:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c677 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929788.045778:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080256:0@lo:256: 00000100:00100000:0.0:1788929788.045824:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929788.045867:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dca49233 going to sleep for 11 seconds 00000100:00100000:1.0:1788929788.045936:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770080256 00000100:00100000:1.0:1788929788.045943:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770080256 00000100:00100000:1.0:1788929788.045990:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788929788.045998:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d753057f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+10:5820:x1875828770080256:12345-0@lo:256: 20000000:01000000:1.0:1788929788.046014:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788929788.046020:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788929788.046100:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d753057f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+10:5820:x1875828770080256:12345-0@lo:256: Request processed in 102us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929788.046108:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788929788.046267:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fee0277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080256:0@lo:256: 10000000:01000000:2.0:1788929788.047031:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788929788.047045:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c677 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929788.047054:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c677 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788929788.047062:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2e86b99000 from 1 10000000:01000000:2.0:1788929788.047065:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788929788.047099:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929788.047107:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929788.047116:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929788.047133:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ddd051db pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080384:0@lo:101: 00000100:00100000:2.0:1788929788.047173:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929788.047202:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000038b24af going to sleep for 11 seconds 00000100:00100000:0.0:1788929788.047469:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770080384 00000100:00100000:0.0:1788929788.047476:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770080384 00000100:00100000:0.0:1788929788.047519:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788929788.047528:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a9f45e6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+10:5820:x1875828770080384:12345-0@lo:101: 00010000:00010000:0.0:1788929788.047551:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929788.047565:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3bf7cc5/0xce4472dd2237c685 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c67e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929788.047652:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3bf7cc5/0xce4472dd2237c685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c67e expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929788.047665:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3bf7cc5/0xce4472dd2237c685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c67e expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929788.047675:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3bf7cc5, rc 0) 00000100:00100000:0.0:1788929788.047716:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a9f45e6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:5820:x1875828770080384:12345-0@lo:101: Request processed in 190us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929788.047722:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788929788.047839:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ddd051db pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080384:0@lo:101: 00010000:00010000:2.0:1788929788.047861:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c685 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929788.047879:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c685 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929788.047934:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ddd051db pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080512:0@lo:501: 00000100:00100000:2.0:1788929788.048027:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929788.048054:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000038b24af going to sleep for 11 seconds 00000100:00100000:0.0:1788929788.048101:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770080512 00000100:00100000:0.0:1788929788.048106:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770080512 00000100:00100000:0.0:1788929788.048138:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788929788.048144:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000043aa5da9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:5820:x1875828770080512:12345-0@lo:501: 00000100:00100000:0.0:1788929788.049818:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000043aa5da9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:5820:x1875828770080512:12345-0@lo:501: Request processed in 1671us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929788.049830:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788929788.050020:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ddd051db pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080512:0@lo:501: 00000100:00100000:2.0:1788929788.050065:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ddd051db pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080640:0@lo:503: 00000100:00100000:2.0:1788929788.050110:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929788.050133:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000038b24af going to sleep for 11 seconds 00000100:00100000:1.0:1788929788.050191:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770080640 00000100:00100000:1.0:1788929788.050198:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770080640 00000100:00100000:1.0:1788929788.050261:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788929788.050270:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001e87c011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:5820:x1875828770080640:12345-0@lo:503: 00000040:00080000:1.0:1788929788.050377:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788929788.050418:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001e87c011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:5820:x1875828770080640:12345-0@lo:503: Request processed in 149us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929788.050424:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788929788.050469:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ddd051db pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080640:0@lo:503: 00000040:00080000:0.0:1788929788.051767:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788929788.051962:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788929788.051984:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788929788.052038:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c685 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929788.052049:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c685 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929788.052091:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788929788.052094:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2e86b99000 10000000:01000000:1.0:1788929788.052097:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2e86b99000 10000000:01000000:1.0:1788929788.052101:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788929788.052106:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2e86b99000 from 1 10000000:01000000:1.0:1788929788.052109:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788929788.052137:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929788.052143:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929788.052153:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929788.052171:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d862c42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080768:0@lo:101: 00000100:00100000:1.0:1788929788.052216:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929788.052469:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000050e47a3 going to sleep for 11 seconds 00000100:00100000:0.0:1788929788.052535:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770080768 00000100:00100000:0.0:1788929788.052541:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770080768 00000100:00100000:0.0:1788929788.052670:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788929788.052679:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004ef732df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:5820:x1875828770080768:12345-0@lo:101: 00010000:00010000:0.0:1788929788.052692:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929788.052704:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e89c6b30/0xce4472dd2237c693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c68c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929788.052739:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e89c6b30/0xce4472dd2237c693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c68c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929788.052751:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e89c6b30/0xce4472dd2237c693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c68c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929788.052759:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e89c6b30, rc 0) 00000100:00100000:0.0:1788929788.052799:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004ef732df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5820:x1875828770080768:12345-0@lo:101: Request processed in 122us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929788.052806:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788929788.052897:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d862c42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080768:0@lo:101: 00010000:00010000:2.0:1788929788.052911:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c693 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929788.052919:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c693 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929788.052965:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e144496f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080896:0@lo:501: 00000100:00100000:2.0:1788929788.052989:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929788.053167:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000008fdcd600 going to sleep for 11 seconds 00000100:00100000:1.0:1788929788.053393:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770080896 00000100:00100000:1.0:1788929788.053398:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770080896 00000100:00100000:1.0:1788929788.053422:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788929788.053437:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001da1111c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5820:x1875828770080896:12345-0@lo:501: 00000100:00100000:1.0:1788929788.054012:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001da1111c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5820:x1875828770080896:12345-0@lo:501: Request processed in 574us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929788.054021:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788929788.054102:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e144496f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770080896:0@lo:501: 00000100:00100000:2.0:1788929788.054141:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e144496f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770081024:0@lo:503: 00000100:00100000:2.0:1788929788.054186:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929788.054219:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000008fdcd600 going to sleep for 11 seconds 00000100:00100000:1.0:1788929788.054362:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770081024 00000100:00100000:1.0:1788929788.054367:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770081024 00000100:00100000:1.0:1788929788.054387:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788929788.054393:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a24f8d53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5820:x1875828770081024:12345-0@lo:503: 00000100:00100000:1.0:1788929788.054868:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a24f8d53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5820:x1875828770081024:12345-0@lo:503: Request processed in 473us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929788.054875:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788929788.054999:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e144496f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770081024:0@lo:503: 00000100:00100000:0.0:1788929788.055519:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008bea50f6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:5867:1875828770081152:0@lo:502: 00000100:00100000:0.0:1788929788.055563:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929788.055678:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cfaf803b going to sleep for 11 seconds 00000100:00100000:2.0:1788929788.055708:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770081152 00000100:00100000:2.0:1788929788.055714:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770081152 00000100:00100000:2.0:1788929788.055783:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788929788.055792:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a7ff0cd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5867:x1875828770081152:12345-0@lo:502: 00000100:00100000:2.0:1788929788.056014:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a7ff0cd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5867:x1875828770081152:12345-0@lo:502: Request processed in 224us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929788.056022:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788929788.056085:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008bea50f6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:5867:1875828770081152:0@lo:502: 00000020:01000004:0.0:1788929788.056140:0:5867:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788929788.056153:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002d3f43d1) 00000020:00000080:0.0:1788929788.056171:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788929788.056261:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001680689b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788929788.056265:0:5867:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001680689b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788929788.056268:0:5867:0:(obd_mount.c:710:lustre_put_lsi()) put 000000001680689b 4 00010000:00080000:0.0:1788929788.056307:0:5867:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a6d9ad13@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:0.0:1788929788.057926:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788929788.058160:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788929788.058192:0:5867:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788929788.058204:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xce4472dd2237c6a1 00000100:00080000:0.0:1788929788.058213:0:5867:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788929788.058245:0:5867:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a6d9ad13 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1788929788.058308:0:5867:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008bea50f6 x1875828770081280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788929788.058342:0:5867:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788929788.062440:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008bea50f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770081280:0@lo:38: 00000100:00100000:1.0:1788929788.062529:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929788.065371:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770081280 00000100:00100000:1.0:1788929788.065387:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770081280 00000100:00100000:1.0:1788929788.065423:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788929788.065429:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012590066 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875828770081280:12345-0@lo:38: 00000100:00100000:1.0:1788929788.065512:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012590066 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875828770081280:12345-0@lo:38: Request processed in 82us (2983us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788929788.065517:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788929788.065554:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788929788.065562:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000a6d9ad13 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788929788.065565:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788929788.065568:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008bea50f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770081280:0@lo:38: 00000100:00100000:1.0:1788929788.066020:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e751b24 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:5867:1875828770081408:0@lo:502: 00000100:00100000:1.0:1788929788.066069:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929788.066102:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770081408 00000100:00100000:1.0:1788929788.066107:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770081408 00000100:00100000:1.0:1788929788.066134:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788929788.066140:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7b34dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5867:x1875828770081408:12345-0@lo:502: 00000100:00100000:1.0:1788929788.066518:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7b34dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5867:x1875828770081408:12345-0@lo:502: Request processed in 377us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929788.066524:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788929788.066649:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df36e5b7 going to sleep for 11 seconds 00000100:00100000:1.0:1788929788.066665:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e751b24 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:5867:1875828770081408:0@lo:502: 00000040:00080000:1.0:1788929788.066689:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788929788.066888:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788929788.066910:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788929788.066930:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c693 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.066940:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c693 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788929788.066986:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788929788.066988:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788929788.066990:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788929788.066991:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788929788.066992:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788929788.066994:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788929788.066995:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788929788.066997:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788929788.066998:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788929788.066999:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788929788.067000:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788929788.067002:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788929788.067006:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788929788.067009:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788929788.067010:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788929788.067011:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788929788.067012:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788929788.067013:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788929788.067014:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788929788.067015:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788929788.067016:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788929788.067017:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788929788.067017:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788929788.067019:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788929788.067020:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788929788.067035:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788929788.067047:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f829f0b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770081536:0@lo:253: 00000100:00100000:3.0:1788929788.067081:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929788.067113:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0afe6c7 going to sleep for 11 seconds 00000100:00100000:0.0:1788929788.067158:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770081536 00000100:00100000:0.0:1788929788.067164:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770081536 00000100:00100000:0.0:1788929788.067200:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788929788.067208:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cc04c29e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5820:x1875828770081536:12345-0@lo:253: 20000000:01000000:0.0:1788929788.067249:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788929788.067262:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788929788.120780:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788929788.120800:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788929788.120966:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788929788.120972:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788929788.120994:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.121012:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000209f159b/0xce4472dd2237c677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c670 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.121020:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.121065:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000209f159b/0xce4472dd2237c677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c670 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.121081:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000209f159b/0xce4472dd2237c677 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c670 expref: 12 pid: 5831 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929788.121095:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bfc5001d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875828770081664:0@lo:104: 00000100:00100000:3.0:1788929788.121173:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929788.121256:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2275504 going to sleep for 11 seconds 00000100:00100000:0.0:1788929788.121402:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770081664 00000100:00100000:0.0:1788929788.121411:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770081664 00000100:00100000:0.0:1788929788.121465:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788929788.121474:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cc3b9e35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:5855:x1875828770081664:12345-0@lo:104: 00010000:00010000:0.0:1788929788.121489:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c677 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929788.121550:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788929788.121556:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cc3b9e35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:5855:x1875828770081664:12345-0@lo:104: Request processed in 84us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929788.121670:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bfc5001d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875828770081664:0@lo:104: 00010000:00010000:3.0:1788929788.121690:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929788.121779:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788929788.121812:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788929788.121818:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c677 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929788.121963:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006f44d0e7 already unused, calling callback (00000000d4da6d87) 10000000:00010000:1.0:1788929788.121966:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c677 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929788.121974:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c677 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788929788.121980:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c677 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929788.121985:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788929788.122017:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c677 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929788.122042:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788929788.122070:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c677 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929788.122076:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: 000000006f44d0e7/0xce4472dd2237c670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c677 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929788.122093:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929788.122095:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929788.122096:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929788.122220:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788929788.122251:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e751b24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770081792:0@lo:103: 00000100:00100000:3.0:1788929788.122286:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929788.122325:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770081792 00000100:00100000:3.0:1788929788.122330:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770081792 00010000:00010000:3.0:1788929788.122348:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000209f159b/0xce4472dd2237c677 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c670 expref: 13 pid: 5831 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929788.122380:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788929788.122386:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bfc5001d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:3308:x1875828770081792:12345-0@lo:103: 00010000:00010000:3.0:1788929788.122397:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929788.122401:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000209f159b/0xce4472dd2237c677 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c670 expref: 13 pid: 5831 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.122410:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000209f159b/0xce4472dd2237c677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c670 expref: 13 pid: 5831 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.122423:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000209f159b/0xce4472dd2237c677 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c670 expref: 13 pid: 5831 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.122435:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.122441:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788929788.122455:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001484084s 00010000:00010000:3.0:1788929788.122459:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.122465:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.122470:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.122475:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.122487:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000541134b5 already unused, calling callback (000000000a507a08) 00010000:00010000:3.0:1788929788.122491:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.122497:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.122509:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.122518:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929788.122547:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bfc5001d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:3308:x1875828770081792:12345-0@lo:103: Request processed in 162us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929788.122554:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788929788.123808:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e751b24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770081792:0@lo:103: 00010000:00010000:3.0:1788929788.124215:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.125002:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929788.125009:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000541134b5/0xce4472dd2237c6a8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929788.136962:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cc04c29e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:5820:x1875828770081536:12345-0@lo:253: Request processed in 69746us (69872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929788.136978:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788929788.137072:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f829f0b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:5820:1875828770081536:0@lo:253: 10000000:01000000:3.0:1788929788.137089:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788929788.137092:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788929788.137095:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788929788.137178:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788929788.137179:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788929788.137181:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788929788.137182:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788929788.137184:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788929788.137185:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788929788.137186:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788929788.137188:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788929788.137189:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788929788.137191:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788929788.137208:0:5820:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788929788.144831:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788929788.145871:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788929788.147357:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788929788.147642:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788929788.147947:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788929788.148132:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788929788.149608:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788929788.150289:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788929788.150736:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788929788.150952:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788929788.151149:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788929788.151590:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788929788.222916:0:5820:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788929788.269780:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788929788.270059:0:5873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1788929788.277440:0:5872:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788929788.277578:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788929788.288641:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788929788.289873:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788929788.290307:0:5820:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788929788.290315:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788929788.290463:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788929788.292340:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788929788.294035:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788929788.294869:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788929788.295469:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788929788.295759:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788929788.297524:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788929788.297670:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788929788.297842:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788929788.297989:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788929788.298155:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788929788.298338:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788929788.298487:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788929788.298620:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788929788.298766:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788929788.298920:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788929788.299067:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788929788.299215:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788929788.299402:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788929788.299582:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788929788.299728:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788929788.299883:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788929788.302562:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788929788.302738:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788929788.302905:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788929788.303055:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788929788.303478:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788929788.303612:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788929788.303831:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788929788.303975:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788929788.304371:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788929788.304522:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788929788.304670:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788929788.304941:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788929788.305663:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788929788.305943:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788929788.306214:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788929788.306562:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788929788.307160:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1788929788.315535:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788929788.331546:0:5873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788929788.411162:0:5820:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788929788.411202:0:5820:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa545c1d67988 00100000:10000000:3.0:1788929788.411253:0:5820:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788929788.412598:0:5820:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788929788.412615:0:5820:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788929788.412628:0:5820:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788929788.412654:0:5820:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788929788.424190:0:5873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788929788.424937:0:5873:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788929788.424942:0:5873:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788929789.341127:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929790.365189:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929791.393875:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929792.423886:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788929793.389405:0:6116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788929793.435372:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788929793.500806:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788929793.500819:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788929793.500822:0:8:0:(import.c:65:import_set_state_nolock()) 00000000a6d9ad13 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788929793.500842:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a6d9ad13 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1788929793.500863:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009dddc8a9 x1875828770082048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788929793.501271:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788929793.501293:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e144496f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770081920:0@lo:400: 00000100:00100000:1.0:1788929793.501395:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009dddc8a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770082048:0@lo:38: 00000100:00100000:0.0:1788929793.501881:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929793.501967:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770081920 00000100:00100000:2.0:1788929793.501982:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770081920 00000100:00100000:2.0:1788929793.502038:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788929793.502049:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067b00600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:3311:x1875828770081920:12345-0@lo:400: 00000100:00100000:2.0:1788929793.502106:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067b00600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:3311:x1875828770081920:12345-0@lo:400: Request processed in 60us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929793.502113:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788929793.502715:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e144496f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770081920:0@lo:400: 00000100:00100000:1.0:1788929793.503076:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929793.503765:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770082048 00000100:00100000:2.0:1788929793.503775:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770082048 00000100:00100000:2.0:1788929793.504681:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788929793.504689:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000708f1088 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875828770082048:12345-0@lo:38: 00010000:00080000:2.0:1788929793.504721:0:5841:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:2.0:1788929793.504777:0:5841:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xce4472dd2237c6af 00000004:00100000:2.0:1788929793.504830:0:5841:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788929793.505365:0:5841:0:(import.c:65:import_set_state_nolock()) 00000000b5e5582f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788929793.505464:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000708f1088 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875828770082048:12345-0@lo:38: Request processed in 762us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929793.505473:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788929793.505567:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009dddc8a9 x1875828770082048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788929803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788929793.505589:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788929793.505598:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788929793.505604:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788929793.505607:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000a6d9ad13 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788929793.505612:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009dddc8a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770082048:0@lo:38: 00010000:00010000:0.0:1788929794.459507:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929795.484016:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929796.507437:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788929796.578299:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788929796.578307:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2e86b99000 from 3 10000000:01000000:3.0:1788929796.578312:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788929796.578374:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: 00000000541134b5/0xce4472dd2237c6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929796.578386:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: 00000000541134b5/0xce4472dd2237c6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929796.578397:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: 00000000541134b5/0xce4472dd2237c6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929796.578420:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f829f0b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770082176:0@lo:101: 00000100:00100000:3.0:1788929796.578491:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929796.578545:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set 00000000be875583 going to sleep for 11 seconds 00000100:00100000:2.0:1788929796.578760:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770082176 00000100:00100000:2.0:1788929796.578767:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770082176 00000100:00100000:2.0:1788929796.578822:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788929796.578830:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000405e40f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:5837:x1875828770082176:12345-0@lo:101: 00010000:00010000:2.0:1788929796.578843:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929796.578857:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e56a7468/0xce4472dd2237c6bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c6b6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929796.578880:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e56a7468/0xce4472dd2237c6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c6b6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929796.578908:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e56a7468/0xce4472dd2237c6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c6b6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929796.578916:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e56a7468, rc 0) 00000100:00100000:2.0:1788929796.578954:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000405e40f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5837:x1875828770082176:12345-0@lo:101: Request processed in 125us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929796.578960:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788929796.579123:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f829f0b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770082176:0@lo:101: 00010000:00010000:3.0:1788929796.579136:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: 00000000541134b5/0xce4472dd2237c6b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c6bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929796.579144:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: 00000000541134b5/0xce4472dd2237c6b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c6bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929796.579641:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f829f0b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770082304:0@lo:256: 00000100:00100000:3.0:1788929796.579677:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929796.579712:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set 00000000be875583 going to sleep for 11 seconds 00000100:00100000:2.0:1788929796.579783:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770082304 00000100:00100000:2.0:1788929796.579788:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770082304 00000100:00100000:2.0:1788929796.579814:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788929796.579820:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000068e8cc96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5837:x1875828770082304:12345-0@lo:256: 20000000:01000000:2.0:1788929796.579833:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788929796.579849:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788929796.579852:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788929796.579917:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000068e8cc96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5837:x1875828770082304:12345-0@lo:256: Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929796.579925:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788929796.580449:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f829f0b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770082304:0@lo:256: 10000000:01000000:3.0:1788929796.580495:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788929796.580505:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: 00000000541134b5/0xce4472dd2237c6b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c6bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929796.580515:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: 00000000541134b5/0xce4472dd2237c6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c6bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929797.531681:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788929798.112610:0:6318:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1bc287a0 20000000:00000080:1.0:1788929798.112630:0:6318:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2eb72e8400 uarg=0000000000000000 20000000:01000000:1.0:1788929798.112675:0:6318:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788929798.112681:0:6318:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788929798.112686:0:6318:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788929798.112979:0:6318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788929798.112992:0:6318:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788929798.123996:0:6318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788929798.124891:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788929798.124964:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788929798.125186:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788929798.125210:0:6318:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788929798.125413:0:6318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929798.125434:0:6318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a3bf7cc5/0xce4472dd2237c685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c67e expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929798.125441:0:6318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929798.125496:0:6318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a3bf7cc5/0xce4472dd2237c685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c67e expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929798.125910:0:6318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a3bf7cc5/0xce4472dd2237c685 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c67e expref: 11 pid: 5833 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929798.125927:0:6318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000891c8a9f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6318:1875828770082432:0@lo:104: 00000100:00100000:0.0:1788929798.125996:0:6318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929798.126450:0:6318:0:(client.c:2716:ptlrpc_set_wait()) set 0000000048fc987d going to sleep for 11 seconds 00000100:00100000:1.0:1788929798.127558:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770082432 00000100:00100000:1.0:1788929798.127571:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770082432 00000100:00100000:0.0:1788929798.127646:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788929798.127672:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005b7c81d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:6318:x1875828770082432:12345-0@lo:104: 00010000:00010000:0.0:1788929798.127696:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c685 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929798.127808:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788929798.127814:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005b7c81d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:6318:x1875828770082432:12345-0@lo:104: Request processed in 159us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929798.127821:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788929798.127895:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788929798.127900:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c685 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.127907:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000dcabfb2 already unused, calling callback (00000000d4da6d87) 10000000:00010000:3.0:1788929798.127911:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c685 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.127918:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c685 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788929798.127925:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c685 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788929798.127930:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788929798.127973:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c685 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.127979:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788929798.127998:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c685 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.128004:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: 000000000dcabfb2/0xce4472dd2237c67e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c685 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.128055:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929798.128057:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929798.128058:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929798.128072:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f829f0b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770082560:0@lo:103: 00000100:00100000:3.0:1788929798.128119:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929798.128169:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770082560 00000100:00100000:3.0:1788929798.128174:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770082560 00010000:00010000:3.0:1788929798.128193:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a3bf7cc5/0xce4472dd2237c685 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c67e expref: 12 pid: 5833 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929798.128221:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788929798.128252:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000053cb4857 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:3311:x1875828770082560:12345-0@lo:103: 00010000:00010000:3.0:1788929798.128262:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929798.128266:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a3bf7cc5/0xce4472dd2237c685 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c67e expref: 12 pid: 5833 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.128276:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a3bf7cc5/0xce4472dd2237c685 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c67e expref: 12 pid: 5833 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.128293:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.128301:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.128315:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.128321:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.128333:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.128338:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.128343:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006f44d0e7 already unused, calling callback (000000000a507a08) 00010000:00010000:3.0:1788929798.128345:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.128351:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.128358:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929798.128366:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929798.128394:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000053cb4857 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:3311:x1875828770082560:12345-0@lo:103: Request processed in 145us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929798.128400:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788929798.128436:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f829f0b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770082560:0@lo:103: 00010000:00010000:1.0:1788929798.128915:0:6318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a3bf7cc5/0xce4472dd2237c685 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c67e expref: 11 pid: 5833 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929798.128927:0:6318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000891c8a9f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6318:1875828770082432:0@lo:104: 00010000:00010000:1.0:1788929798.128940:0:6318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929798.128948:0:6318:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929798.128952:0:6318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929798.128957:0:6318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f44d0e7/0xce4472dd2237c6c4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929798.556120:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929798.626309:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f829f0b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770082688:0@lo:400: 00000100:00100000:3.0:1788929798.626386:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929798.626472:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770082688 00000100:00100000:3.0:1788929798.626481:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770082688 00000100:00100000:3.0:1788929798.626530:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788929798.626538:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000058b47615 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770082688:12345-0@lo:400: 00000100:00100000:3.0:1788929798.626586:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000058b47615 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770082688:12345-0@lo:400: Request processed in 49us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929798.626600:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788929798.626641:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f829f0b5 x1875828770082688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929798.626667:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f829f0b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770082688:0@lo:400: 00010000:00010000:3.0:1788929799.588263:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929800.604550:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929801.632476:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929802.652558:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929803.675877:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929803.739499:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770082944:0@lo:400: 00000100:00100000:1.0:1788929803.739582:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929803.739656:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770082944 00000100:00100000:1.0:1788929803.739664:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770082944 00000100:00100000:1.0:1788929803.739708:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788929803.739715:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000030004548 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770082944:12345-0@lo:400: 00000100:00100000:1.0:1788929803.739765:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000030004548 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770082944:12345-0@lo:400: Request processed in 50us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929803.739771:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788929803.739811:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001d235f8f x1875828770082944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929803.739825:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770082944:0@lo:400: 00000100:00100000:0.0:1788929803.739886:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788929803.739896:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031360272 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770082816:0@lo:400: 00000100:00100000:0.0:1788929803.739931:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929803.740120:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770082816 00000100:00100000:1.0:1788929803.740125:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770082816 00000100:00100000:1.0:1788929803.740199:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788929803.740206:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bda438ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:3308:x1875828770082816:12345-0@lo:400: 00000100:00100000:1.0:1788929803.740272:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bda438ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:3308:x1875828770082816:12345-0@lo:400: Request processed in 67us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929803.740278:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788929803.740374:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031360272 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770082816:0@lo:400: 00010000:00010000:0.0:1788929804.701909:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788929804.774720:0:6682:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788929804.774725:0:6682:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788929804.774873:0:6682:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006e0c4f15 00000020:01000004:2.0:1788929804.774891:0:6682:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788929804.774904:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788929804.774918:0:6682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000802e5c16) 00000020:00000080:2.0:1788929804.774933:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788929804.788194:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788929804.788560:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788929804.809323:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788929804.814311:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788929804.814351:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788929804.814409:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788929804.814434:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788929804.814795:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788929804.814806:0:6682:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788929804.814816:0:6682:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xce4472dd2237c6d2 00000020:01000004:1.0:1788929804.814824:0:6682:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788929804.814846:0:6682:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.140@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788929804.814850:0:6682:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788929804.814855:0:6682:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788929804.814859:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788929804.814869:0:6682:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000008ad24487) 00000020:00000080:1.0:1788929804.814880:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1788929804.816380:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788929804.817047:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788929804.817063:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788929804.826617:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788929804.826635:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788929804.827636:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788929804.827645:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788929804.829361:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788929804.829589:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788929804.829596:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788929804.830643:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788929804.830654:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788929804.862648:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788929804.862900:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788929804.862907:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788929804.866660:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788929804.866676:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788929804.867545:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788929804.867556:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788929804.873513:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788929804.874264:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788929804.874271:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788929804.882457:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788929804.882481:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788929804.926502:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788929804.926733:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788929804.926739:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788929804.927781:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788929804.927791:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788929804.928295:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788929804.928336:0:6682:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788929804.928343:0:6682:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788929804.964659:0:6682:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788929804.964702:0:6682:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.140@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788929804.964706:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788929804.964708:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788929804.964709:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788929804.964710:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788929804.964711:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788929804.964712:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788929804.964714:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788929804.964715:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788929804.964716:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788929804.964717:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788929804.964719:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788929804.964722:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788929804.964725:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788929804.964726:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788929804.964727:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788929804.964728:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788929804.964729:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788929804.964730:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788929804.964730:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788929804.964731:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788929804.964732:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788929804.964733:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788929804.964734:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788929804.964763:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788929804.964781:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b820192e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770083072:0@lo:253: 00000100:00100000:2.0:1788929804.965093:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929804.965202:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3904b23 going to sleep for 11 seconds 00000100:00100000:3.0:1788929804.965572:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770083072 00000100:00100000:3.0:1788929804.965583:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770083072 00000100:00100000:3.0:1788929804.965682:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788929804.965692:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004e1987c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770083072:12345-0@lo:253: 20000000:01000000:3.0:1788929804.965725:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788929804.965729:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788929804.965735:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788929804.965739:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788929804.967172:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788929804.967416:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788929804.967430:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788929804.967465:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788929804.967473:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788929804.967498:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788929804.967553:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788929804.968201:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788929804.968250:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.140@tcp 20000000:01000000:3.0:1788929804.968252:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.140@tcp (null) (null) (null) 00000040:00080000:3.0:1788929804.968288:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788929804.968295:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788929804.968340:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788929804.968347:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.140@tcp (null) (null) 00000040:00080000:3.0:1788929804.968377:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788929804.968386:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788929804.968414:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788929804.968457:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788929804.970074:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788929804.970105:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.140@tcp 20000000:01000000:3.0:1788929804.970107:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.140@tcp (null) (null) (null) 00000040:00080000:3.0:1788929804.970143:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788929804.970151:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788929804.970181:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788929804.970188:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.140@tcp (null) (null) 00000040:00080000:3.0:1788929804.970271:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788929804.970281:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788929804.970314:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788929804.970345:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788929804.970363:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788929804.970366:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788929804.970370:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788929804.970384:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788929804.970386:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788929804.970420:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788929804.970422:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788929804.971116:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788929804.978135:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788929804.978261:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788929804.978369:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788929804.978397:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788929804.978400:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788929804.980170:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788929804.980473:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788929804.980543:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788929804.986861:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788929804.986949:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788929804.987027:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788929804.987041:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788929804.987044:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788929804.996290:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788929804.996384:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788929804.996435:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788929804.996944:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788929804.997011:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788929804.997045:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788929804.997061:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788929804.997063:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788929804.997071:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788929804.997090:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929804.997110:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009c448e87/0xce4472dd2237c607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c600 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929804.997118:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c4fe51f0/0xce4472dd2237c623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c61c expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929804.997124:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e89c6b30/0xce4472dd2237c693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c68c expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929804.997130:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929804.997172:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e89c6b30/0xce4472dd2237c693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c68c expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929804.997185:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e89c6b30/0xce4472dd2237c693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c68c expref: 11 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929804.997198:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0b378df pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770083200:0@lo:104: 00000100:00100000:2.0:1788929804.997296:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788929804.997364:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c4fe51f0/0xce4472dd2237c623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c61c expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929804.997382:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c4fe51f0/0xce4472dd2237c623 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c61c expref: 11 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929804.997389:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e5f9049 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770083328:0@lo:104: 00000100:00100000:2.0:1788929804.997412:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788929804.997440:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009c448e87/0xce4472dd2237c607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c600 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929804.997446:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009c448e87/0xce4472dd2237c607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c600 expref: 11 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929804.997453:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003239b5ca pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770083456:0@lo:104: 00000100:00100000:2.0:1788929804.997472:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929804.997481:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b320d465 going to sleep for 11 seconds 00000100:00100000:0.0:1788929804.997560:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770083200 00000100:00100000:0.0:1788929804.997568:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770083200 00000100:00100000:0.0:1788929804.997603:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770083328 00000100:00100000:0.0:1788929804.997605:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770083328 00000100:00100000:0.0:1788929804.997615:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770083456 00000100:00100000:0.0:1788929804.997618:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770083456 00000100:00100000:0.0:1788929804.997630:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788929804.997636:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a43e922b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+5:5834:x1875828770083200:12345-0@lo:104: 00010000:00010000:0.0:1788929804.997647:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c693 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.997705:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788929804.997710:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a43e922b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+5:5834:x1875828770083200:12345-0@lo:104: Request processed in 75us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929804.997716:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788929804.997732:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788929804.997737:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006815d602 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+4:5834:x1875828770083328:12345-0@lo:104: 00010000:00010000:0.0:1788929804.997744:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c623 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.997774:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788929804.997778:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006815d602 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+4:5834:x1875828770083328:12345-0@lo:104: Request processed in 42us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929804.997784:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788929804.997795:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788929804.997819:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000baf1ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:5834:x1875828770083456:12345-0@lo:104: 00010000:00010000:0.0:1788929804.997825:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c607 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.997850:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788929804.997853:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000baf1ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:5834:x1875828770083456:12345-0@lo:104: Request processed in 37us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929804.997858:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788929804.997874:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788929804.997879:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c693 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.997886:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004cee38dd already unused, calling callback (00000000d4da6d87) 10000000:00010000:0.0:1788929804.997889:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c693 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.997896:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c693 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788929804.997902:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c693 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929804.997906:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788929804.997929:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c693 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.997934:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788929804.997955:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c693 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.997970:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: 000000004cee38dd/0xce4472dd2237c68c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c693 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.997983:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788929804.997985:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c623 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.997990:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d9e4facd already unused, calling callback (00000000d4da6d87) 10000000:00010000:0.0:1788929804.997992:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c623 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.997998:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c623 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788929804.998003:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c623 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929804.998008:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788929804.998021:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c623 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.998027:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788929804.998039:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c623 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.998046:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c61c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c623 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.998054:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788929804.998061:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c607 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.998066:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000065623583 already unused, calling callback (00000000d4da6d87) 10000000:00010000:0.0:1788929804.998068:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c607 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.998073:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c607 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788929804.998078:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c607 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929804.998082:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788929804.998093:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c607 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.998099:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788929804.998103:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c607 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.998108:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: 0000000065623583/0xce4472dd2237c600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c607 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.998123:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929804.998125:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929804.998127:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929804.998148:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa1d53c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770083712:0@lo:103: 00000100:00100000:0.0:1788929804.998175:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929804.998199:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788929804.998203:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2146230 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770083840:0@lo:103: 00000100:00100000:0.0:1788929804.998258:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929804.998589:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0b378df pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770083200:0@lo:104: 00000100:00100000:2.0:1788929804.998597:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e5f9049 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770083328:0@lo:104: 00000100:00100000:2.0:1788929804.998602:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003239b5ca pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770083456:0@lo:104: 00010000:00010000:2.0:1788929804.998622:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929804.999086:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929804.999105:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770083712 00000100:00100000:3.0:1788929804.999111:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770083712 00010000:00010000:3.0:1788929804.999139:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c4fe51f0/0xce4472dd2237c623 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c61c expref: 12 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929804.999169:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770083840 00000100:00100000:3.0:1788929804.999172:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770083840 00010000:00010000:3.0:1788929804.999183:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009c448e87/0xce4472dd2237c607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c600 expref: 13 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929804.999195:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788929804.999202:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f3efccef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:3308:x1875828770083712:12345-0@lo:103: 00010000:00010000:3.0:1788929804.999218:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929804.999247:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c4fe51f0/0xce4472dd2237c623 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c61c expref: 13 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929804.999256:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c4fe51f0/0xce4472dd2237c623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c61c expref: 13 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929804.999268:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c4fe51f0/0xce4472dd2237c623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c61c expref: 13 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929804.999298:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929804.999346:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f3efccef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:3308:x1875828770083712:12345-0@lo:103: Request processed in 145us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929804.999353:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788929804.999368:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788929804.999373:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000944f37cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:3308:x1875828770083840:12345-0@lo:103: 00010000:00010000:3.0:1788929804.999380:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929804.999383:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009c448e87/0xce4472dd2237c607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c600 expref: 11 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929804.999390:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009c448e87/0xce4472dd2237c607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c600 expref: 11 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929804.999399:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009c448e87/0xce4472dd2237c607 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c600 expref: 11 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929804.999408:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929804.999430:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000944f37cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+10:3308:x1875828770083840:12345-0@lo:103: Request processed in 57us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929804.999435:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788929804.999467:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2146230 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770083840:0@lo:103: 00000100:00100000:3.0:1788929804.999475:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa1d53c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770083712:0@lo:103: 00000100:00100000:2.0:1788929804.999567:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032f61d24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770083584:0@lo:103: 00000100:00100000:2.0:1788929804.999600:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929804.999684:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770083584 00000100:00100000:0.0:1788929804.999688:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770083584 00010000:00010000:0.0:1788929804.999703:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e89c6b30/0xce4472dd2237c693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c68c expref: 10 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929804.999731:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788929804.999736:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003239b5ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+10:3311:x1875828770083584:12345-0@lo:103: 00010000:00010000:0.0:1788929804.999743:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929804.999746:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e89c6b30/0xce4472dd2237c693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c68c expref: 10 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.999753:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e89c6b30/0xce4472dd2237c693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c68c expref: 10 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.999761:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e89c6b30/0xce4472dd2237c693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c68c expref: 10 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.999772:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.999779:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.999791:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.999797:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.999813:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.999826:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.999832:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fd8ad376 already unused, calling callback (000000000a507a08) 00010000:00010000:0.0:1788929804.999835:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.999842:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.999854:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929804.999862:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929804.999888:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003239b5ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+9:3311:x1875828770083584:12345-0@lo:103: Request processed in 152us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929804.999894:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788929804.999950:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032f61d24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770083584:0@lo:103: 00010000:00010000:2.0:1788929804.999967:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929804.999993:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929804.999998:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fd8ad376/0xce4472dd2237c6e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788929805.000013:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788929805.064078:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004e1987c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+8:6682:x1875828770083072:12345-0@lo:253: Request processed in 98382us (98979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929805.064096:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788929805.067132:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b820192e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770083072:0@lo:253: 10000000:01000000:0.0:1788929805.067155:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788929805.067159:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788929805.067160:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788929805.067162:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788929805.067163:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788929805.067164:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788929805.067165:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788929805.067167:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788929805.067168:0:6682:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788929805.067169:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788929805.067170:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788929805.067201:0:6682:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006e0c4f15 from lustre-OST0000 10000000:01000000:0.0:1788929805.067257:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788929805.067273:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788929805.067281:0:6682:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2e8637b380 local copy 10000000:01000000:0.0:1788929805.067285:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788929805.067330:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.067342:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.067351:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929805.067374:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a2783bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770083968:0@lo:101: 00000100:00100000:0.0:1788929805.067431:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.067545:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c76a1f8d going to sleep for 11 seconds 00000100:00100000:1.0:1788929805.067888:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770083968 00000100:00100000:1.0:1788929805.067898:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770083968 00000100:00100000:1.0:1788929805.074264:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788929805.074291:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a87e3169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+8:6682:x1875828770083968:12345-0@lo:101: 00010000:00010000:1.0:1788929805.074313:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929805.074335:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bc01b7d0/0xce4472dd2237c6ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c6e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.074371:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc01b7d0/0xce4472dd2237c6ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c6e7 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.074384:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bc01b7d0/0xce4472dd2237c6ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c6e7 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.074393:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bc01b7d0, rc 0) 00000100:00100000:1.0:1788929805.074479:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a87e3169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+9:6682:x1875828770083968:12345-0@lo:101: Request processed in 203us (7048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929805.074485:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788929805.074697:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a2783bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770083968:0@lo:101: 00010000:00010000:0.0:1788929805.074717:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xce4472dd2237c6ee expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.074727:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xce4472dd2237c6ee expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929805.074885:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a2783bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084096:0@lo:501: 00000100:00100000:0.0:1788929805.074921:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.075440:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c76a1f8d going to sleep for 11 seconds 00000100:00100000:2.0:1788929805.076058:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770084096 00000100:00100000:2.0:1788929805.076067:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770084096 00000100:00100000:2.0:1788929805.076124:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788929805.076132:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024c8d7c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+9:6682:x1875828770084096:12345-0@lo:501: 00000100:00100000:2.0:1788929805.076399:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024c8d7c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+9:6682:x1875828770084096:12345-0@lo:501: Request processed in 267us (1477us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788929805.076407:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788929805.076552:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a2783bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084096:0@lo:501: 10000000:01000000:0.0:1788929805.076576:0:6682:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788929805.076612:0:6682:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788929805.076619:0:6682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xce4472dd2237c6ee expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.076640:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xce4472dd2237c6ee expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.076648:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xce4472dd2237c6ee expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.076673:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788929805.076701:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2eb5357800 10000000:01000000:0.0:1788929805.076705:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788929805.076710:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d2e8637b380 10000000:01000000:0.0:1788929805.076712:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788929805.076716:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d2e8637b380 from 1 10000000:01000000:0.0:1788929805.076719:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788929805.076744:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c6f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.076752:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c6f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.076761:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c6f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929805.076777:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a2783bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084224:0@lo:101: 00000100:00100000:0.0:1788929805.076809:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.076844:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ce85f93 going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.076912:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770084224 00000100:00100000:3.0:1788929805.076919:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770084224 00000100:00100000:3.0:1788929805.076954:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788929805.076961:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000048e45c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+9:6682:x1875828770084224:12345-0@lo:101: 00010000:00010000:3.0:1788929805.076985:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929805.076997:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000053803936/0xce4472dd2237c6fc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c6f5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.077018:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000053803936/0xce4472dd2237c6fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c6f5 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.077027:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000053803936/0xce4472dd2237c6fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c6f5 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.077035:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000053803936, rc 0) 00000100:00100000:3.0:1788929805.077073:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000048e45c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+10:6682:x1875828770084224:12345-0@lo:101: Request processed in 113us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.077080:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788929805.077206:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a2783bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084224:0@lo:101: 00010000:00010000:1.0:1788929805.077218:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c6f5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c6fc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.077256:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c6f5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c6fc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929805.077278:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788929805.077287:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c6f5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c6fc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.077293:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: 00000000d9e4facd/0xce4472dd2237c6f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c6fc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929805.077299:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788929805.077303:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788929805.077307:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788929805.077309:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788929805.077322:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: 00000000096929de/0xce4472dd2237c703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.077328:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: 00000000096929de/0xce4472dd2237c703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.077335:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: 00000000096929de/0xce4472dd2237c703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929805.077345:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084352:0@lo:101: 00000100:00100000:1.0:1788929805.077372:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.077393:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e754c17d going to sleep for 11 seconds 00000100:00100000:1.0:1788929805.077409:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770084352 00000100:00100000:1.0:1788929805.077413:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770084352 00000100:00100000:1.0:1788929805.077435:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788929805.077440:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002648d3dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+10:6682:x1875828770084352:12345-0@lo:101: 00010000:00010000:1.0:1788929805.077446:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929805.077459:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003f974345/0xce4472dd2237c70a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c703 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.077471:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003f974345/0xce4472dd2237c70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c703 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.077478:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003f974345/0xce4472dd2237c70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c703 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.077484:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003f974345, rc 0) 00000100:00100000:1.0:1788929805.077509:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002648d3dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770084352:12345-0@lo:101: Request processed in 69us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929805.077514:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788929805.077554:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084352:0@lo:101: 00010000:00010000:1.0:1788929805.077563:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: 00000000096929de/0xce4472dd2237c703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c70a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.077570:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: 00000000096929de/0xce4472dd2237c703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c70a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929805.077635:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084480:0@lo:501: 00000100:00100000:1.0:1788929805.077658:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.077670:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e754c17d going to sleep for 11 seconds 00000100:00100000:1.0:1788929805.077681:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770084480 00000100:00100000:1.0:1788929805.077685:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770084480 00000100:00100000:1.0:1788929805.077700:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788929805.077704:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000065d7486d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770084480:12345-0@lo:501: 00000100:00100000:1.0:1788929805.077891:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000065d7486d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770084480:12345-0@lo:501: Request processed in 186us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929805.077906:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788929805.077936:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084480:0@lo:501: 00000100:00100000:1.0:1788929805.077959:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084608:0@lo:503: 00000100:00100000:1.0:1788929805.078067:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.078081:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013118085 going to sleep for 11 seconds 00000100:00100000:1.0:1788929805.078094:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770084608 00000100:00100000:1.0:1788929805.078097:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770084608 00000100:00100000:1.0:1788929805.078113:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788929805.078118:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000386de066 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770084608:12345-0@lo:503: 00000100:00100000:1.0:1788929805.078292:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000386de066 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770084608:12345-0@lo:503: Request processed in 173us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929805.078300:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788929805.078332:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084608:0@lo:503: 00000040:00080000:1.0:1788929805.078588:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788929805.078642:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084736:0@lo:502: 00000100:00100000:1.0:1788929805.078675:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.078698:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013118085 going to sleep for 11 seconds 00000100:00100000:1.0:1788929805.078711:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770084736 00000100:00100000:1.0:1788929805.078715:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770084736 00000100:00100000:1.0:1788929805.078731:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788929805.078736:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000e911fb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770084736:12345-0@lo:502: 00000100:00100000:1.0:1788929805.078849:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000e911fb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770084736:12345-0@lo:502: Request processed in 113us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929805.078858:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788929805.078892:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084736:0@lo:502: 00010000:00010000:2.0:1788929805.079382:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788929805.079392:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xce4472dd2237c6ee expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929805.079403:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e89c6b30 already unused, calling callback (00000000d4da6d87) 10000000:00010000:2.0:1788929805.079407:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xce4472dd2237c6ee expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929805.079417:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xce4472dd2237c6ee expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788929805.079437:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xce4472dd2237c6ee expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788929805.079444:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788929805.079474:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xce4472dd2237c6ee expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929805.079481:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788929805.079504:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xce4472dd2237c6ee expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929805.079511:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: 00000000e89c6b30/0xce4472dd2237c6e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xce4472dd2237c6ee expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929805.079539:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929805.079541:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929805.079543:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929805.079555:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e5f9049 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770084864:0@lo:103: 00000100:00100000:2.0:1788929805.079587:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929805.079648:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770084864 00000100:00100000:2.0:1788929805.079654:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770084864 00000100:00100000:2.0:1788929805.079694:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788929805.079702:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b0b378df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:3310:x1875828770084864:12345-0@lo:103: 00010000:00010000:2.0:1788929805.079716:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929805.079735:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bc01b7d0/0xce4472dd2237c6ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237c6e7 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929805.079749:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929805.079785:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b0b378df pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+10:3310:x1875828770084864:12345-0@lo:103: Request processed in 84us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929805.079792:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788929805.079819:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e5f9049 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770084864:0@lo:103: 00000040:00080000:2.0:1788929805.080549:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788929805.080637:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788929805.080687:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788929805.080756:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788929805.080797:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788929805.080836:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788929805.080877:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e5f9049 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084992:0@lo:502: 00000100:00100000:2.0:1788929805.080925:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929805.080957:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 000000002868edad going to sleep for 11 seconds 00000100:00100000:1.0:1788929805.081604:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770084992 00000100:00100000:1.0:1788929805.081612:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770084992 00000100:00100000:1.0:1788929805.081657:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788929805.081664:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f10e090f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+10:6682:x1875828770084992:12345-0@lo:502: 00000100:00100000:1.0:1788929805.081862:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f10e090f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+10:6682:x1875828770084992:12345-0@lo:502: Request processed in 198us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929805.081869:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788929805.082059:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e5f9049 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770084992:0@lo:502: 00000040:00080000:2.0:1788929805.082188:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788929805.082204:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1788929805.094334:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788929805.094349:0:6702:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788929805.094356:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929805.094358:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788929805.094365:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788929805.094379:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000000e4104bb) 00000020:00000080:3.0:1788929805.094400:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788929805.094406:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788929805.094462:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006e0c4f15 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788929805.094470:0:6702:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788929805.094475:0:6702:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xce4472dd2237c718 00010000:00010000:2.0:1788929805.099830:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788929805.100508:0:6702:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788929805.102847:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788929805.103455:0:6702:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788929805.110733:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788929805.111755:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788929805.115310:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788929805.115323:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788929805.115329:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788929805.115331:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788929805.115335:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788929805.115339:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788929805.115340:0:6702:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788929805.115350:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788929805.115352:0:6702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788929805.115406:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788929805.115410:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788929805.115411:0:6702:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788929805.115413:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788929805.116313:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788929805.116346:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788929805.116370:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: 00000000096929de/0xce4472dd2237c703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c70a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.116385:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: 00000000096929de/0xce4472dd2237c703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c70a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929805.116393:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2eb5357800 from 1 10000000:01000000:1.0:1788929805.116395:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788929805.116433:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: 00000000f0ea7637/0xce4472dd2237c71f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.116440:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: 00000000f0ea7637/0xce4472dd2237c71f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.116451:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: 00000000f0ea7637/0xce4472dd2237c71f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929805.116475:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085120:0@lo:101: 00000100:00100000:1.0:1788929805.116572:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.116623:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 000000009cd3fb46 going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.116884:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770085120 00000100:00100000:3.0:1788929805.116892:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770085120 00000100:00100000:3.0:1788929805.116938:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788929805.116946:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001064ddbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+10:6682:x1875828770085120:12345-0@lo:101: 00010000:00010000:3.0:1788929805.116961:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929805.116995:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000681b8142/0xce4472dd2237c726 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c71f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.117020:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000681b8142/0xce4472dd2237c726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c71f expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.117030:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000681b8142/0xce4472dd2237c726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c71f expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.117038:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000681b8142, rc 0) 00000100:00100000:3.0:1788929805.117079:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001064ddbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770085120:12345-0@lo:101: Request processed in 134us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.117086:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788929805.117500:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085120:0@lo:101: 00010000:00010000:1.0:1788929805.117517:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: 00000000f0ea7637/0xce4472dd2237c71f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c726 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.117525:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: 00000000f0ea7637/0xce4472dd2237c71f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c726 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929805.117632:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085248:0@lo:501: 00000100:00100000:1.0:1788929805.117661:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.117692:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 000000009cd3fb46 going to sleep for 11 seconds 00000100:00100000:2.0:1788929805.117736:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770085248 00000100:00100000:2.0:1788929805.117741:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770085248 00000100:00100000:2.0:1788929805.117772:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788929805.117780:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a3066e91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770085248:12345-0@lo:501: 00000100:00100000:2.0:1788929805.118465:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a3066e91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770085248:12345-0@lo:501: Request processed in 684us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929805.118474:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788929805.118583:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085248:0@lo:501: 00000100:00100000:1.0:1788929805.118616:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085376:0@lo:503: 00000100:00100000:1.0:1788929805.118656:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.118689:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 000000009cd3fb46 going to sleep for 11 seconds 00000100:00100000:2.0:1788929805.118733:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770085376 00000100:00100000:2.0:1788929805.118739:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770085376 00000100:00100000:2.0:1788929805.118811:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788929805.118819:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000064bb75de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770085376:12345-0@lo:503: 00000100:00100000:2.0:1788929805.119081:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000064bb75de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770085376:12345-0@lo:503: Request processed in 263us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929805.119088:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788929805.121270:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085376:0@lo:503: 00000040:00080000:1.0:1788929805.121647:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788929805.121758:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085504:0@lo:502: 00000100:00100000:1.0:1788929805.121824:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.129283:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 0000000047d7760a going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.135187:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770085504 00000100:00100000:3.0:1788929805.135206:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770085504 00000100:00100000:3.0:1788929805.135332:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788929805.135341:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000260924bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770085504:12345-0@lo:502: 00000100:00100000:3.0:1788929805.135812:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000260924bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770085504:12345-0@lo:502: Request processed in 472us (13987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.135821:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788929805.138218:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d235f8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085504:0@lo:502: 00000040:00080000:0.0:1788929805.142901:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788929805.143092:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788929805.143197:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c337654 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085632:0@lo:502: 00000100:00100000:0.0:1788929805.143355:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.143474:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 00000000029ebfd5 going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.143636:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770085632 00000100:00100000:3.0:1788929805.143645:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770085632 00000100:00100000:3.0:1788929805.143729:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788929805.143737:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000085298f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770085632:12345-0@lo:502: 00000100:00100000:3.0:1788929805.143941:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000085298f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770085632:12345-0@lo:502: Request processed in 205us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.143949:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788929805.144074:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c337654 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085632:0@lo:502: 00000040:00080000:0.0:1788929805.144191:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788929805.144201:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788929805.144809:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788929805.144818:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788929805.144821:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788929805.144828:0:6706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2eb5357800 00000020:00000080:0.0:1788929805.144830:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788929805.144867:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788929805.144870:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788929805.144872:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788929805.144874:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788929805.145049:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788929805.145073:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788929805.145096:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237c71f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c726 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.145108:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237c71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c726 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929805.145154:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788929805.145157:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2eb5357800 10000000:01000000:1.0:1788929805.145161:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2eb5357800 10000000:01000000:1.0:1788929805.145165:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788929805.145171:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2eb5357800 from 1 10000000:01000000:1.0:1788929805.145174:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788929805.145206:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.145215:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.145253:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929805.145274:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085760:0@lo:101: 00000100:00100000:1.0:1788929805.145317:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.145701:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22240 going to sleep for 11 seconds 00000100:00100000:2.0:1788929805.145763:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770085760 00000100:00100000:2.0:1788929805.145770:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770085760 00000100:00100000:2.0:1788929805.145804:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788929805.145812:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770085760:12345-0@lo:101: 00010000:00010000:2.0:1788929805.145826:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929805.145839:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c734 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c72d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929805.145863:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c72d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929805.145885:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c72d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929805.145895:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ea3c53800, rc 0) 00000100:00100000:2.0:1788929805.145942:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6682:x1875828770085760:12345-0@lo:101: Request processed in 130us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929805.145950:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788929805.146077:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085760:0@lo:101: 00010000:00010000:1.0:1788929805.146090:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c734 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.146100:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c734 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929805.146211:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085888:0@lo:501: 00000100:00100000:1.0:1788929805.146256:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.146465:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22240 going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.146537:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770085888 00000100:00100000:3.0:1788929805.146542:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770085888 00000100:00100000:3.0:1788929805.146573:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788929805.146578:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6682:x1875828770085888:12345-0@lo:501: 00000100:00100000:3.0:1788929805.146808:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6682:x1875828770085888:12345-0@lo:501: Request processed in 228us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.146815:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788929805.146897:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770085888:0@lo:501: 00000100:00100000:1.0:1788929805.146924:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770086016:0@lo:503: 00000100:00100000:1.0:1788929805.146959:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.146989:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22240 going to sleep for 11 seconds 00000100:00100000:0.0:1788929805.147077:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770086016 00000100:00100000:0.0:1788929805.147081:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770086016 00000100:00100000:0.0:1788929805.147115:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788929805.147122:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6682:x1875828770086016:12345-0@lo:503: 00000100:00100000:0.0:1788929805.147286:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6682:x1875828770086016:12345-0@lo:503: Request processed in 164us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929805.147293:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788929805.147425:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770086016:0@lo:503: 00000040:00080000:1.0:1788929805.147718:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788929805.147775:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770086144:0@lo:502: 00000100:00100000:1.0:1788929805.147809:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.147842:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22240 going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.147903:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770086144 00000100:00100000:3.0:1788929805.147908:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770086144 00000100:00100000:3.0:1788929805.147928:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788929805.147934:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6682:x1875828770086144:12345-0@lo:502: 00000100:00100000:3.0:1788929805.148265:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6682:x1875828770086144:12345-0@lo:502: Request processed in 167us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.148274:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788929805.148375:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770086144:0@lo:502: 00000040:00080000:1.0:1788929805.148630:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788929805.148684:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788929805.148714:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788929805.148770:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788929805.148808:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788929805.148866:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788929805.148905:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788929805.148938:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788929805.149057:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788929805.149096:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788929805.149314:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788929805.149358:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788929805.149391:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788929805.149420:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788929805.149461:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788929805.149493:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788929805.149521:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788929805.149601:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788929805.149648:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788929805.149678:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788929805.149722:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788929805.149756:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788929805.149787:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788929805.149843:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788929805.149883:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788929805.149915:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788929805.149958:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788929805.150682:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1788929805.150735:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770086272:0@lo:502: 00000100:00100000:1.0:1788929805.150814:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.150899:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22240 going to sleep for 11 seconds 00000100:00100000:2.0:1788929805.150981:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770086272 00000100:00100000:2.0:1788929805.150988:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770086272 00000100:00100000:3.0:1788929805.151113:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788929805.151125:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6682:x1875828770086272:12345-0@lo:502: 00000100:00100000:3.0:1788929805.151381:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6682:x1875828770086272:12345-0@lo:502: Request processed in 258us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.151389:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788929805.151600:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770086272:0@lo:502: 00000040:00080000:1.0:1788929805.151678:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788929805.151689:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788929805.152520:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788929805.152549:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d2eb728cd40) 00000020:00000080:1.0:1788929805.152571:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788929805.152661:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2eb5357800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788929805.152666:0:6707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2eb5357800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788929805.152668:0:6707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2eb5357800 3 00010000:00080000:1.0:1788929805.152707:0:6707:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2e85c17000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.140@tcp at head 00010000:00010000:1.0:1788929805.155607:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788929805.155797:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788929805.155835:0:6707:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788929805.155848:0:6707:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xce4472dd2237c742 00000100:00080000:1.0:1788929805.155858:0:6707:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788929805.155868:0:6707:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d2e85c17000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788929805.155906:0:6707:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2eb61cce00 x1875828770086400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788929805.155942:0:6707:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788929805.161633:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770086528:0@lo:400: 00000100:00100000:3.0:1788929805.161710:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929805.161770:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770086528 00000100:00100000:3.0:1788929805.161778:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770086528 00000100:00100000:3.0:1788929805.161824:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788929805.161833:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770086528:12345-0@lo:400: 00000100:00100000:3.0:1788929805.161890:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770086528:12345-0@lo:400: Request processed in 58us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.161896:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788929805.161949:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2eb61cfb80 x1875828770086528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929805.161963:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770086528:0@lo:400: 00000100:00100000:0.0:1788929805.162423:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875828770086400:0@lo:38: 00000100:00100000:0.0:1788929805.162461:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929805.162542:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770086400 00000100:00100000:3.0:1788929805.162548:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770086400 00000100:00100000:3.0:1788929805.162604:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788929805.162609:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875828770086400:12345-0@lo:38: 00010000:00080000:3.0:1788929805.162632:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1788929805.162681:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xce4472dd2237c749 00000004:00100000:3.0:1788929805.162697:0:5840:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788929805.162728:0:5840:0:(import.c:65:import_set_state_nolock()) ffff8d2d84874000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788929805.162771:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875828770086400:12345-0@lo:38: Request processed in 160us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.162778:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788929805.163887:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2eb61cce00 x1875828770086400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788929815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929805.163900:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788929805.163908:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788929805.163917:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788929805.163921:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788929805.163925:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e85c17000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788929805.163931:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875828770086400:0@lo:38: 00000040:00080000:2.0:1788929805.166670:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788929805.166812:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788929805.166835:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788929805.166858:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c734 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.166872:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c734 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788929805.166936:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788929805.166938:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788929805.166939:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788929805.166940:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788929805.166942:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788929805.166943:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788929805.166944:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788929805.166945:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788929805.166947:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788929805.166948:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788929805.166949:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788929805.166953:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788929805.166955:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788929805.166956:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788929805.166957:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788929805.166958:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788929805.166959:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788929805.166960:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788929805.166961:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788929805.166962:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788929805.166963:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788929805.166963:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788929805.166964:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788929805.166998:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788929805.167016:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770086656:0@lo:253: 00000100:00100000:0.0:1788929805.167099:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.167149:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e22480 going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.167656:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770086656 00000100:00100000:3.0:1788929805.167665:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770086656 00000100:00100000:3.0:1788929805.167750:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788929805.167761:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6682:x1875828770086656:12345-0@lo:253: 20000000:01000000:3.0:1788929805.167792:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788929805.167808:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788929805.223954:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788929805.224058:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788929805.236909:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788929805.236923:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788929805.237111:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.237134:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c6bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c6b6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.237143:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.237190:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c6b6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.237208:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c6bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c6b6 expref: 12 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929805.237252:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61ce680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875828770086784:0@lo:104: 00000100:00100000:1.0:1788929805.237319:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.237383:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22840 going to sleep for 11 seconds 00000100:00100000:0.0:1788929805.237449:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770086784 00000100:00100000:0.0:1788929805.237458:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770086784 00000100:00100000:0.0:1788929805.237514:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788929805.237523:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:5855:x1875828770086784:12345-0@lo:104: 00010000:00010000:0.0:1788929805.237547:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c6bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.237621:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788929805.237628:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:5855:x1875828770086784:12345-0@lo:104: Request processed in 107us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929805.237635:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788929805.237656:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788929805.237663:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c6bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.237670:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153800 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788929805.237674:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c6bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.237683:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c6bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788929805.237691:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c6bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929805.237697:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788929805.237727:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c6b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c6bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.237733:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788929805.237752:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c6b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c6bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.237759:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c6b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c6bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.237788:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929805.237790:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929805.237792:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929805.237807:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770086912:0@lo:103: 00000100:00100000:0.0:1788929805.237840:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.237875:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770086912 00000100:00100000:0.0:1788929805.237878:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770086912 00010000:00010000:0.0:1788929805.237894:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c6bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c6b6 expref: 13 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929805.237915:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788929805.237921:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:3308:x1875828770086912:12345-0@lo:103: 00010000:00010000:0.0:1788929805.237933:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929805.237937:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c6bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c6b6 expref: 13 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.237948:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c6bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c6b6 expref: 13 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.237964:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.238033:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788929805.238048:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001484084s 00010000:00010000:0.0:1788929805.238053:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.238069:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.238076:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.238081:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.238087:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788929805.238091:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.238098:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.238107:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.238117:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929805.238147:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:3308:x1875828770086912:12345-0@lo:103: Request processed in 225us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929805.238153:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788929805.238214:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770086912:0@lo:103: 00010000:00010000:2.0:1788929805.238342:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c6bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c6b6 expref: 12 pid: 5833 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929805.238354:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61ce680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875828770086784:0@lo:104: 00010000:00010000:2.0:1788929805.238367:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929805.238376:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929805.238389:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929805.238395:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c750 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929805.253091:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:6682:x1875828770086656:12345-0@lo:253: Request processed in 85321us (85981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929805.253121:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788929805.253419:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:6682:1875828770086656:0@lo:253: 10000000:01000000:0.0:1788929805.253438:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788929805.253443:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788929805.253445:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788929805.253446:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788929805.253464:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788929805.253466:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788929805.253468:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788929805.253470:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788929805.253471:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788929805.253473:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788929805.253475:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788929805.253476:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788929805.253495:0:6682:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788929805.258960:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788929805.259195:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788929805.259444:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788929805.259620:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788929805.259819:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788929805.260149:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788929805.261606:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:1.0:1788929805.344903:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788929805.344913:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2e86b99000 from 21 10000000:01000000:1.0:1788929805.344920:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788929805.344993:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.345005:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.345020:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929805.345050:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770087040:0@lo:101: 00000100:00100000:1.0:1788929805.345930:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.346090:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22840 going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.346412:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770087040 00000100:00100000:3.0:1788929805.346422:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770087040 00000100:00100000:3.0:1788929805.346477:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788929805.346488:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:5837:x1875828770087040:12345-0@lo:101: 00010000:00010000:3.0:1788929805.346504:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929805.346540:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ec2153800/0xce4472dd2237c75e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c757 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.346649:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ec2153800/0xce4472dd2237c75e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c757 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.346661:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ec2153800/0xce4472dd2237c75e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c757 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.346671:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153800, rc 0) 00000100:00100000:3.0:1788929805.346727:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5837:x1875828770087040:12345-0@lo:101: Request processed in 241us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.346734:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788929805.349479:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770087040:0@lo:101: 00010000:00010000:1.0:1788929805.349511:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c75e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.349537:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c75e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929805.349616:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770087168:0@lo:501: 00000100:00100000:1.0:1788929805.349674:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.349754:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22840 going to sleep for 11 seconds 00000100:00100000:2.0:1788929805.355625:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770087168 00000100:00100000:2.0:1788929805.355644:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770087168 00000100:00100000:0.0:1788929805.362396:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788929805.362409:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5837:x1875828770087168:12345-0@lo:501: 00000100:00100000:0.0:1788929805.362677:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5837:x1875828770087168:12345-0@lo:501: Request processed in 270us (13002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929805.362685:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788929805.362738:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770087168:0@lo:501: 00000100:00100000:0.0:1788929805.362785:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770087296:0@lo:503: 00000100:00100000:0.0:1788929805.362829:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929805.376860:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770087296 00000100:00100000:3.0:1788929805.376875:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770087296 00000100:00100000:3.0:1788929805.376932:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788929805.376943:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5837:x1875828770087296:12345-0@lo:503: 00000100:00100000:3.0:1788929805.377212:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5837:x1875828770087296:12345-0@lo:503: Request processed in 271us (14381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.377242:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788929805.386754:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e22c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788929805.386796:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770087296:0@lo:503: 00000100:00100000:1.0:1788929805.387752:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:6711:1875828770087424:0@lo:502: 00000100:00100000:1.0:1788929805.387825:0:6711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.387862:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d226c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.387923:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770087424 00000100:00100000:3.0:1788929805.387930:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770087424 00000100:00100000:3.0:1788929805.388093:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788929805.388112:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6711:x1875828770087424:12345-0@lo:502: 00000100:00100000:3.0:1788929805.388366:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6711:x1875828770087424:12345-0@lo:502: Request processed in 264us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.388374:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788929805.388468:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:6711:1875828770087424:0@lo:502: 00000100:00100000:1.0:1788929805.388511:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:6711:1875828770087552:0@lo:502: 00000100:00100000:1.0:1788929805.388554:0:6711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.388590:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d226c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929805.388645:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770087552 00000100:00100000:0.0:1788929805.388649:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770087552 00000100:00100000:0.0:1788929805.388682:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788929805.388703:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6711:x1875828770087552:12345-0@lo:502: 00000100:00100000:0.0:1788929805.388829:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:6711:x1875828770087552:12345-0@lo:502: Request processed in 140us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929805.388836:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788929805.389081:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:6711:1875828770087552:0@lo:502: 00000040:00080000:1.0:1788929805.389099:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788929805.389289:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788929805.389307:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788929805.389316:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c75e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.389333:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c75e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929805.389343:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788929805.389346:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2e86b99000 from 4 10000000:01000000:0.0:1788929805.389348:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788929805.389374:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.389382:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.389391:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929805.389405:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770087680:0@lo:101: 00000100:00100000:0.0:1788929805.389434:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.389462:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e22780 going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.389511:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770087680 00000100:00100000:3.0:1788929805.389516:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770087680 00000100:00100000:3.0:1788929805.389560:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788929805.389567:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5837:x1875828770087680:12345-0@lo:101: 00010000:00010000:3.0:1788929805.389576:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929805.389588:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ec2152200/0xce4472dd2237c76c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c765 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.389607:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ec2152200/0xce4472dd2237c76c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c765 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.389617:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ec2152200/0xce4472dd2237c76c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c765 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.389624:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152200, rc 0) 00000100:00100000:3.0:1788929805.389661:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:5837:x1875828770087680:12345-0@lo:101: Request processed in 93us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.389667:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788929805.389915:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770087680:0@lo:101: 00010000:00010000:0.0:1788929805.389927:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c76c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.389935:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c76c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929805.390098:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770087808:0@lo:256: 00000100:00100000:0.0:1788929805.390137:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.390165:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e22780 going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.390213:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770087808 00000100:00100000:3.0:1788929805.390218:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770087808 00000100:00100000:3.0:1788929805.390271:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788929805.390279:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:5837:x1875828770087808:12345-0@lo:256: 20000000:01000000:3.0:1788929805.390293:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788929805.390309:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788929805.390312:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788929805.390390:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:5837:x1875828770087808:12345-0@lo:256: Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.390397:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788929805.390479:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770087808:0@lo:256: 10000000:01000000:1.0:1788929805.390520:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788929805.390537:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c76c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.390545:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c76c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929805.390551:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788929805.390552:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788929805.390555:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788929805.390571:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.390577:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.390584:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929805.390595:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770087936:0@lo:101: 00000100:00100000:1.0:1788929805.390621:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.390637:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d226c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.390680:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770087936 00000100:00100000:3.0:1788929805.390684:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770087936 00000100:00100000:3.0:1788929805.390713:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788929805.390725:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:5837:x1875828770087936:12345-0@lo:101: 00010000:00010000:3.0:1788929805.390734:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929805.390743:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c77a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c773 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.390758:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c77a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c773 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.390766:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c77a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c773 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.390772:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153c00, rc 0) 00000100:00100000:3.0:1788929805.390801:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770087936:12345-0@lo:101: Request processed in 76us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.390807:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788929805.390835:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770087936:0@lo:101: 00010000:00010000:3.0:1788929805.390844:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c77a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.390854:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c77a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929805.390905:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770088064:0@lo:501: 00000100:00100000:3.0:1788929805.390929:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929805.390947:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770088064 00000100:00100000:3.0:1788929805.390950:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770088064 00000100:00100000:3.0:1788929805.392139:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788929805.392153:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770088064:12345-0@lo:501: 00000100:00100000:3.0:1788929805.392455:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770088064:12345-0@lo:501: Request processed in 306us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.392463:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788929805.392503:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.392519:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770088064:0@lo:501: 00000100:00100000:3.0:1788929805.392568:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770088192:0@lo:503: 00000100:00100000:3.0:1788929805.392606:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929805.392626:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788929805.392638:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770088192 00000100:00100000:3.0:1788929805.392644:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770088192 00000100:00100000:3.0:1788929805.392668:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788929805.392673:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770088192:12345-0@lo:503: 00000100:00100000:3.0:1788929805.392818:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770088192:12345-0@lo:503: Request processed in 144us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929805.392825:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788929805.392877:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770088192:0@lo:503: 00000100:00100000:0.0:1788929805.399812:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:6712:1875828770088320:0@lo:502: 00000100:00100000:0.0:1788929805.399898:0:6712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.399940:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770088320 00000100:00100000:0.0:1788929805.399950:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770088320 00000100:00100000:0.0:1788929805.400157:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788929805.400167:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:6712:x1875828770088320:12345-0@lo:502: 00000100:00100000:0.0:1788929805.400424:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:6712:x1875828770088320:12345-0@lo:502: Request processed in 257us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929805.400432:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788929805.400484:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e22780 going to sleep for 11 seconds 00000100:00100000:0.0:1788929805.400504:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:6712:1875828770088320:0@lo:502: 00000020:01000000:0.0:1788929805.400542:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788929805.400549:0:6712:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788929805.400555:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788929805.400558:0:6712:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788929805.400563:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788929805.400566:0:6712:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:0.0:1788929805.400588:0:6712:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788929805.400590:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788929805.400604:0:6712:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d2e863799c0) 00000020:00000080:0.0:1788929805.400626:0:6712:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788929805.400631:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788929805.400717:0:6712:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788929805.400723:0:6712:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788929805.400729:0:6712:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237c788 00010000:00080000:0.0:1788929805.400763:0:6712:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2d85ebe800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:0.0:1788929805.401173:0:6712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788929805.504623:0:6712:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788929805.504666:0:6712:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788929805.505444:0:6712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788929805.505651:0:6712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788929805.505701:0:6712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788929805.505759:0:6712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788929805.510025:0:6713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788929805.510033:0:6713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788929805.511517:0:6712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788929805.511543:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788929805.511580:0:6712:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788929805.511600:0:6712:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237c78f 00000100:00080000:0.0:1788929805.511611:0:6712:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788929805.511624:0:6712:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2d85ebe800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1788929805.511660:0:6712:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ebbffa680 x1875828770088448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788929805.511678:0:6712:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788929805.511730:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788929805.511734:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788929805.511736:0:6712:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788929805.511740:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788929805.511743:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788929805.511745:0:6712:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788929805.511748:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788929805.511750:0:6712:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788929805.511777:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:6712:1875828770088576:0@lo:502: 00000100:00100000:0.0:1788929805.511846:0:6712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.511890:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90286600 going to sleep for 11 seconds 00000100:00100000:0.0:1788929805.511927:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770088576 00000100:00100000:0.0:1788929805.511934:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770088576 00000100:00100000:2.0:1788929805.512103:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770088448:0@lo:8: 00000100:00100000:2.0:1788929805.512140:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929805.512176:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770088448 00000100:00100000:2.0:1788929805.512181:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770088448 00000100:00100000:2.0:1788929805.512204:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788929805.512211:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875828770088448:12345-0@lo:8: 00000100:00100000:2.0:1788929805.512283:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875828770088448:12345-0@lo:8: Request processed in 70us (141us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788929805.512289:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788929805.512320:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788929805.512328:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2d85ebe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788929805.512332:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788929805.512335:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770088448:0@lo:8: 00000100:00100000:0.0:1788929805.512467:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788929805.512476:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:6712:x1875828770088576:12345-0@lo:502: 00000100:00100000:0.0:1788929805.512705:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:6712:x1875828770088576:12345-0@lo:502: Request processed in 229us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929805.512712:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788929805.513701:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:6712:1875828770088576:0@lo:502: 00000020:01000000:0.0:1788929805.513740:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788929805.513747:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788929805.513749:0:6712:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788929805.513754:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788929805.513915:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788929805.513933:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788929805.513943:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c77a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.513955:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c77a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788929805.513979:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788929805.513982:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2e86b99000 from 1 10000000:01000000:3.0:1788929805.513985:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788929805.514021:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.514028:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929805.514037:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929805.514053:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770088704:0@lo:101: 00000100:00100000:3.0:1788929805.514098:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929805.514169:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929805.514483:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770088704 00000100:00100000:0.0:1788929805.514490:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770088704 00000100:00100000:0.0:1788929805.514532:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788929805.514541:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770088704:12345-0@lo:101: 00010000:00010000:0.0:1788929805.514553:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929805.514566:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e80031e00/0xce4472dd2237c79d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c796 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.514591:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e80031e00/0xce4472dd2237c79d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c796 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.514601:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e80031e00/0xce4472dd2237c79d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c796 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.514609:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e80031e00, rc 0) 00000100:00100000:0.0:1788929805.514645:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770088704:12345-0@lo:101: Request processed in 105us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929805.514651:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788929805.514700:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770088704:0@lo:101: 00010000:00010000:0.0:1788929805.514712:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c79d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.514728:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c79d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929805.514775:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770088832:0@lo:501: 00000100:00100000:0.0:1788929805.514798:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.514815:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e902869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929805.514827:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770088832 00000100:00100000:0.0:1788929805.514830:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770088832 00000100:00100000:0.0:1788929805.514850:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788929805.514856:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770088832:12345-0@lo:501: 00000100:00100000:0.0:1788929805.515065:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770088832:12345-0@lo:501: Request processed in 208us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929805.515072:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788929805.515100:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770088832:0@lo:501: 00000100:00100000:0.0:1788929805.515123:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770088960:0@lo:503: 00000100:00100000:0.0:1788929805.515155:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.515167:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e8820f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929805.515178:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770088960 00000100:00100000:0.0:1788929805.515181:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770088960 00000100:00100000:0.0:1788929805.515198:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788929805.515204:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770088960:12345-0@lo:503: 00000100:00100000:0.0:1788929805.515368:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770088960:12345-0@lo:503: Request processed in 163us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929805.515374:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788929805.515410:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770088960:0@lo:503: 00000100:00100000:1.0:1788929805.515845:0:6715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:6715:1875828770089088:0@lo:502: 00000100:00100000:1.0:1788929805.515881:0:6715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.515908:0:6715:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22840 going to sleep for 11 seconds 00000100:00100000:0.0:1788929805.516048:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770089088 00000100:00100000:0.0:1788929805.516054:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770089088 00000100:00100000:0.0:1788929805.516121:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788929805.516129:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:6715:x1875828770089088:12345-0@lo:502: 00000100:00100000:0.0:1788929805.516295:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:6715:x1875828770089088:12345-0@lo:502: Request processed in 166us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929805.516302:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788929805.520339:0:6715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:6715:1875828770089088:0@lo:502: 00000020:01000000:1.0:1788929805.520392:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788929805.520402:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788929805.520404:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788929805.520411:0:6715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2e86b99000 00000020:00000080:1.0:1788929805.520414:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788929805.520463:0:6715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:6715:1875828770089216:0@lo:502: 00000100:00100000:1.0:1788929805.520555:0:6715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929805.520601:0:6715:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22840 going to sleep for 11 seconds 00000100:00100000:2.0:1788929805.520675:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770089216 00000100:00100000:2.0:1788929805.520683:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770089216 00000100:00100000:2.0:1788929805.520728:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788929805.520743:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:6715:x1875828770089216:12345-0@lo:502: 00000100:00100000:2.0:1788929805.520975:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:6715:x1875828770089216:12345-0@lo:502: Request processed in 217us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929805.520983:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788929805.521482:0:6715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:6715:1875828770089216:0@lo:502: 00000020:01000000:1.0:1788929805.521508:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788929805.521513:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788929805.521515:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788929805.521519:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788929805.522256:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788929805.522284:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788929805.522295:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c79d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.522306:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c79d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929805.522315:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788929805.522317:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2e8637b380 from 1 10000000:01000000:0.0:1788929805.522320:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788929805.522352:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.522360:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.522370:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929805.522389:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770089344:0@lo:101: 00000100:00100000:0.0:1788929805.522441:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.522479:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90286900 going to sleep for 11 seconds 00000100:00100000:1.0:1788929805.522626:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770089344 00000100:00100000:1.0:1788929805.522632:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770089344 00000100:00100000:1.0:1788929805.522674:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788929805.522683:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770089344:12345-0@lo:101: 00010000:00010000:1.0:1788929805.522695:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929805.522707:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e99784400/0xce4472dd2237c7ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c7a4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.522729:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e99784400/0xce4472dd2237c7ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c7a4 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.522738:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e99784400/0xce4472dd2237c7ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c7a4 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929805.522747:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99784400, rc 0) 00000100:00100000:1.0:1788929805.522790:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770089344:12345-0@lo:101: Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929805.522797:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00002000:00080000:1.0:1788929805.523296:0:6682:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788929805.523302:0:6682:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788929805.523335:0:6682:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788929805.523405:0:6682:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788929805.523420:0:6682:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788929805.523451:0:6682:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000100:00100000:0.0:1788929805.524196:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770089344:0@lo:101: 00010000:00010000:0.0:1788929805.524219:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c7ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.524247:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c7ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929805.524313:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770089472:0@lo:501: 00000100:00100000:0.0:1788929805.524357:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929805.524387:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90286900 going to sleep for 11 seconds 00000100:00100000:0.0:1788929805.524404:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770089472 00000100:00100000:0.0:1788929805.524409:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770089472 00000100:00100000:0.0:1788929805.524444:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788929805.524453:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770089472:12345-0@lo:501: 00000100:00100000:0.0:1788929805.524635:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770089472:12345-0@lo:501: Request processed in 183us (277us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788929805.524643:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788929805.524677:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770089472:0@lo:501: 10000000:01000000:0.0:1788929805.524697:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788929805.524703:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c7ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929805.524712:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c7ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929805.729035:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929806.747784:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929807.778260:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929808.795556:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929809.819879:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929810.845764:0:126:0:(ldlm_pool.c:1330:ldlm_pools_recalc_task()) Negative interval(0) 00010000:00010000:0.0:1788929810.851430:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788929810.908453:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788929810.908460:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788929810.908464:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2d85ebe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788929810.908479:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2d85ebe800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1788929810.908497:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ebbff9c00 x1875828770089984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788929810.908533:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770089728:0@lo:400: 00000100:00100000:0.0:1788929810.908589:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929810.908635:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929810.908640:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770089856:0@lo:400: 00000100:00100000:0.0:1788929810.908657:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929810.908757:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770089984:0@lo:8: 00000100:00100000:0.0:1788929810.908791:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929810.908832:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770089728 00000100:00100000:0.0:1788929810.908840:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770089728 00000100:00100000:0.0:1788929810.908878:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770089856 00000100:00100000:0.0:1788929810.908882:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770089856 00000100:00100000:0.0:1788929810.908908:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788929810.908917:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770089728:12345-0@lo:400: 00000100:00100000:0.0:1788929810.908969:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770089728:12345-0@lo:400: Request processed in 53us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929810.908976:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788929810.908993:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788929810.908999:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770089856:12345-0@lo:400: 00000100:00100000:0.0:1788929810.909025:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770089856:12345-0@lo:400: Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929810.909041:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788929810.909081:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2ebbffa300 x1875828770089856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929810.909095:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770089856:0@lo:400: 00000100:00100000:2.0:1788929810.909333:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788929810.909344:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770089600:0@lo:400: 00000100:00100000:2.0:1788929810.909380:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929810.910364:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770089984 00000100:00100000:3.0:1788929810.910373:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770089984 00000100:00100000:3.0:1788929810.910406:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788929810.910412:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875828770089984:12345-0@lo:8: 00010000:00080000:3.0:1788929810.910447:0:6688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:3.0:1788929810.910475:0:6688:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237c7b2 00002000:00100000:3.0:1788929810.910518:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d2d84876800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788929810.910523:0:6688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788929810.910527:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788929810.910642:0:6688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1788929810.910793:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2ebbff8700 x1875828770089728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929810.910808:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770089728:0@lo:400: 00000100:00100000:0.0:1788929810.910848:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770089600 00000100:00100000:0.0:1788929810.910852:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770089600 00000100:00100000:0.0:1788929810.910880:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788929810.910888:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3308:x1875828770089600:12345-0@lo:400: 00000100:00100000:0.0:1788929810.910959:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3308:x1875828770089600:12345-0@lo:400: Request processed in 71us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929810.910965:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788929810.911495:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770089600:0@lo:400: 00002000:00080000:3.0:1788929810.914443:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788929810.914481:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8d2d84872800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788929810.914565:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875828770089984:12345-0@lo:8: Request processed in 4151us (5771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929810.914585:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788929810.914622:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788929810.914843:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2ebbff9c00 x1875828770089984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788929820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788929810.914861:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788929810.914872:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788929810.914878:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788929810.914881:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2d85ebe800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788929810.914896:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788929810.914901:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770089984:0@lo:8: 00000004:00080000:0.0:1788929810.915066:0:6713:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788929810.916891:0:6713:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 196072664564ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788929811.117445:0:6714:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788929811.117477:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1875828770090240:0@lo:7: 00000100:00100000:1.0:1788929811.117548:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929811.117603:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98397840 going to sleep for 11 seconds 00000004:00080000:1.0:1788929811.117622:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788929811.117662:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770090112:0@lo:13: 00000100:00100000:1.0:1788929811.117708:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929811.118522:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770090240 00000100:00100000:1.0:1788929811.118532:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770090240 00000100:00100000:1.0:1788929811.118593:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788929811.118603:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788929811.118605:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6714:x1875828770090240:12345-0@lo:7: 00000100:00100000:2.0:1788929811.118615:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1788929811.120825:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788929811.120856:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770090112 00000100:00100000:2.0:1788929811.120868:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770090112 00000100:00100000:2.0:1788929811.120993:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788929811.121005:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875828770090112:12345-0@lo:13: 00002000:00000024:2.0:1788929811.121048:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788929811.122273:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875828770090112:12345-0@lo:13: Request processed in 1254us (4548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929811.122284:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788929811.135403:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2eb61cf800 x1875828770090112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929811.135443:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770090112:0@lo:13: 00002000:00080000:1.0:1788929811.139465:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788929811.139474:0:6687:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788929811.139582:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6714:x1875828770090240:12345-0@lo:7: Request processed in 20977us (22030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929811.139593:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788929811.139648:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2eb61cc000 x1875828770090240/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788929827 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929811.139665:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1875828770090240:0@lo:7: 00000004:00080000:2.0:1788929811.139687:0:6714:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788929811.139727:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1875828770090368:0@lo:5: 00000100:00100000:2.0:1788929811.139764:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929811.139816:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788929811.142148:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770090368 00000100:00100000:3.0:1788929811.142165:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770090368 00000100:00100000:3.0:1788929811.142278:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788929811.142288:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6714:x1875828770090368:12345-0@lo:5: 00002000:00080000:3.0:1788929811.142319:0:6688:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788929811.142325:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788929811.142769:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6714:x1875828770090368:12345-0@lo:5: Request processed in 482us (3003us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788929811.142776:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788929811.149425:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2e863fca80 x1875828770090368/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788929827 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929811.149447:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1875828770090368:0@lo:5: 00000004:00080000:1.0:1788929811.149462:0:6714:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788929811.149513:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1875828770090496:0@lo:700: 00000100:00100000:1.0:1788929811.149567:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929811.149604:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98397b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788929811.150788:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770090496 00000100:00100000:3.0:1788929811.150802:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770090496 00000100:00100000:3.0:1788929811.150874:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788929811.150884:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6714:x1875828770090496:12345-0@lo:700: 00000100:00100000:3.0:1788929811.150939:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1875828770090624:0@lo:700: 00000100:00100000:3.0:1788929811.151691:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929811.151728:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e93f00b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788929811.152744:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770090624 00000100:00100000:2.0:1788929811.152757:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770090624 00000100:00100000:2.0:1788929811.152818:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788929811.152828:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1875828770090624:12345-0@lo:700: 40000000:02000000:3.0:1788929811.224655:0:5846:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788929811.240490:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1875828770090624:12345-0@lo:700: Request processed in 87656us (88794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929811.240507:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788929811.241667:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2e90314700 x1875828770090624/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788929827 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929811.241683:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1875828770090624:0@lo:700: 40000000:02000000:3.0:1788929811.241697:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1788929811.390601:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788929811.390616:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788929811.395873:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6714:x1875828770090496:12345-0@lo:700: Request processed in 244980us (246295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929811.395893:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788929811.397033:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2eb61cc000 x1875828770090496/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788929827 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929811.397054:0:6714:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788929811.397083:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1875828770090496:0@lo:700: 00000004:02000040:3.0:1788929811.471619:0:6714:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788929811.486681:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1875828770090752:0@lo:5: 00000100:00100000:3.0:1788929811.486759:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929811.487633:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e93f006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788929811.488117:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770090752 00000100:00100000:1.0:1788929811.488128:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770090752 00000100:00100000:0.0:1788929811.488219:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788929811.488258:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:6714:x1875828770090752:12345-0@lo:5: 00002000:00080000:0.0:1788929811.500085:0:6989:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788929811.500108:0:6989:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788929811.521431:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:6714:x1875828770090752:12345-0@lo:5: Request processed in 33168us (34664us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788929811.521444:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788929811.521476:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2e90314700 x1875828770090752/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788929827 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929811.521493:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1875828770090752:0@lo:5: 00000004:00080000:2.0:1788929811.521509:0:6714:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788929811.868768:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788929812.689528:0:7059:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788929812.898053:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929813.915435:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929814.941084:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929815.964889:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929816.028850:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770091136:0@lo:400: 00000100:00100000:2.0:1788929816.028913:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929816.028965:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788929816.028971:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770091008:0@lo:400: 00000100:00100000:2.0:1788929816.028999:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929816.029027:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770091136 00000100:00100000:2.0:1788929816.029034:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770091136 00000100:00100000:2.0:1788929816.029078:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770091008 00000100:00100000:2.0:1788929816.029091:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770091008 00000100:00100000:2.0:1788929816.029109:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788929816.029117:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770091136:12345-0@lo:400: 00000100:00100000:2.0:1788929816.029164:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770091136:12345-0@lo:400: Request processed in 48us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929816.029170:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788929816.029190:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788929816.029196:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770091008:12345-0@lo:400: 00000100:00100000:2.0:1788929816.029267:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770091008:12345-0@lo:400: Request processed in 25us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929816.029275:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788929816.029294:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788929816.029332:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2e863fd880 x1875828770091008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929816.029347:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770091008:0@lo:400: 00010000:00080000:2.0:1788929816.029359:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2e863fd500 x1875828770091136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929816.029366:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770091136:0@lo:400: 00000100:00100000:3.0:1788929816.029493:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770091264:0@lo:400: 00000100:00100000:3.0:1788929816.029525:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929816.029558:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788929816.029564:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770090880:0@lo:400: 00000100:00100000:3.0:1788929816.029599:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929816.029891:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770090880 00000100:00100000:0.0:1788929816.029896:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770090880 00000100:00100000:0.0:1788929816.030028:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788929816.030037:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3308:x1875828770090880:12345-0@lo:400: 00000100:00100000:0.0:1788929816.030081:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3308:x1875828770090880:12345-0@lo:400: Request processed in 46us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929816.030086:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788929816.030499:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770090880:0@lo:400: 00000100:00100000:2.0:1788929816.031169:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770091264 00000100:00100000:2.0:1788929816.031176:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770091264 00000100:00100000:2.0:1788929816.031263:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788929816.031272:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875828770091264:12345-0@lo:400: 00000100:00100000:2.0:1788929816.031337:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875828770091264:12345-0@lo:400: Request processed in 66us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929816.031343:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788929816.031397:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788929816.031439:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2e863fed80 x1875828770091264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929816.031452:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770091264:0@lo:400: 00000100:00100000:3.0:1788929816.539552:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788929816.539594:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770091392:0@lo:13: 00000100:00100000:3.0:1788929816.539682:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929816.539772:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770091392 00000100:00100000:3.0:1788929816.539781:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770091392 00000100:00100000:3.0:1788929816.539828:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788929816.539837:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875828770091392:12345-0@lo:13: 00002000:00000024:3.0:1788929816.539888:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929816.539949:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875828770091392:12345-0@lo:13: Request processed in 113us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929816.539956:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788929816.540096:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2e863fd500 x1875828770091392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929816.540117:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770091392:0@lo:13: 00000001:00080000:0.0:1788929816.703458:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788929816.990163:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929818.014824:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929819.035499:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929820.064436:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929821.084441:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929821.150043:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770091520:0@lo:400: 00000100:00100000:0.0:1788929821.150113:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929821.150169:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929821.150178:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770091648:0@lo:400: 00000100:00100000:0.0:1788929821.150206:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929821.150260:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770091648 00000100:00100000:1.0:1788929821.150272:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770091648 00000100:00100000:0.0:1788929821.150284:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770091776:0@lo:400: 00000100:00100000:0.0:1788929821.150313:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929821.150325:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770091776 00000100:00100000:1.0:1788929821.150330:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770091776 00000100:00100000:0.0:1788929821.150338:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788929821.150346:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770091904:0@lo:400: 00000100:00100000:1.0:1788929821.150364:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788929821.150375:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770091648:12345-0@lo:400: 00000100:00100000:0.0:1788929821.150391:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929821.150441:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770091648:12345-0@lo:400: Request processed in 67us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929821.150444:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770091520 00000100:00100000:0.0:1788929821.150450:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770091520 00000100:00100000:1.0:1788929821.150453:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788929821.150476:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788929821.150485:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770091776:12345-0@lo:400: 00000100:00100000:0.0:1788929821.150491:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788929821.150502:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3310:x1875828770091520:12345-0@lo:400: 00000100:00100000:1.0:1788929821.150522:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770091776:12345-0@lo:400: Request processed in 38us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929821.150529:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788929821.150547:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3310:x1875828770091520:12345-0@lo:400: Request processed in 46us (431us total) trans 0 rc 0/0 00000100:00080000:1.0:1788929821.150553:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929821.150557:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788929821.150608:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770091904 00000100:00100000:0.0:1788929821.150612:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770091904 00000100:00100000:0.0:1788929821.150653:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788929821.150660:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770091904:12345-0@lo:400: 00000100:00100000:0.0:1788929821.150691:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770091904:12345-0@lo:400: Request processed in 32us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929821.150698:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788929821.150733:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2ebbff8700 x1875828770091648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929821.150746:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770091648:0@lo:400: 00000100:00100000:0.0:1788929821.150755:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770091520:0@lo:400: 00010000:00080000:0.0:1788929821.150786:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2ebbffbb80 x1875828770091904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929821.150795:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788929821.150804:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770091904:0@lo:400: 00010000:00080000:0.0:1788929821.150814:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2ebbffa300 x1875828770091776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929821.150836:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770091776:0@lo:400: 00000100:00080000:1.0:1788929821.152335:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788929821.660993:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788929821.661018:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770092032:0@lo:13: 00000100:00100000:3.0:1788929821.661084:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929821.661147:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770092032 00000100:00100000:3.0:1788929821.661155:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770092032 00000100:00100000:3.0:1788929821.661199:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788929821.661206:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770092032:12345-0@lo:13: 00002000:00000024:3.0:1788929821.661270:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929821.661316:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770092032:12345-0@lo:13: Request processed in 109us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929821.661322:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788929821.661360:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2e90316300 x1875828770092032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929821.661378:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770092032:0@lo:13: 00010000:00010000:0.0:1788929822.107455:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929823.132759:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788929823.623988:0:7622:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788929823.623993:0:7622:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788929823.624142:0:7622:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2d85d86800 00000020:01000004:1.0:1788929823.624167:0:7622:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788929823.624189:0:7622:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788929823.624206:0:7622:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d2eb72899c0) 00000020:00000080:1.0:1788929823.624262:0:7622:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788929823.638890:0:7622:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788929823.640288:0:7622:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788929823.668157:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788929823.677072:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788929823.677111:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788929823.677175:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788929823.677220:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788929823.679250:0:7622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788929823.679265:0:7622:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788929823.679432:0:7622:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xce4472dd2237c7c0 00000020:01000004:3.0:1788929823.679442:0:7622:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788929823.679474:0:7622:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788929823.679478:0:7622:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788929823.679486:0:7622:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788929823.679510:0:7622:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788929823.679618:0:7622:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788929823.706919:0:7622:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788929823.706960:0:7622:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.140@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788929823.706965:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788929823.706966:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788929823.706968:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788929823.706969:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788929823.706971:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788929823.706972:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788929823.706973:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788929823.706975:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788929823.706976:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788929823.706978:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788929823.706980:0:7622:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788929823.706983:0:7622:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788929823.706985:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788929823.706986:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788929823.706988:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788929823.706989:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788929823.706990:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788929823.706991:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788929823.706992:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788929823.706993:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788929823.706994:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788929823.706995:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788929823.706996:0:7622:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788929823.707037:0:7622:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788929823.707054:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770092160:0@lo:253: 00000100:00100000:0.0:1788929823.707127:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929823.707434:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87cbcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788929823.708852:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770092160 00000100:00100000:1.0:1788929823.708863:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770092160 00000100:00100000:1.0:1788929823.708954:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788929823.708965:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:7622:x1875828770092160:12345-0@lo:253: 20000000:01000000:1.0:1788929823.709000:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788929823.709005:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788929823.709010:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788929823.709013:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788929823.711136:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788929823.714006:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788929823.714043:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788929823.714115:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788929823.714123:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788929823.714170:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788929823.714258:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788929823.717261:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788929823.717458:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.140@tcp 20000000:01000000:1.0:1788929823.717461:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.140@tcp (null) (null) (null) 00000040:00080000:1.0:1788929823.717500:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788929823.717508:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788929823.717758:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788929823.717767:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.140@tcp (null) (null) 00000040:00080000:1.0:1788929823.717805:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788929823.717815:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788929823.717850:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788929823.717902:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788929823.719069:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788929823.719521:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.140@tcp 20000000:01000000:1.0:1788929823.719524:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.140@tcp (null) (null) (null) 00000040:00080000:1.0:1788929823.719567:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788929823.719575:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788929823.719607:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788929823.719615:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.140@tcp (null) (null) 00000040:00080000:1.0:1788929823.719900:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788929823.719911:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788929823.719972:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788929823.720011:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788929823.720034:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788929823.720037:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788929823.720046:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788929823.720047:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788929823.720050:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788929823.720066:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788929823.720069:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788929823.720111:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788929823.720114:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788929823.721818:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788929823.721926:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788929823.721959:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788929823.722806:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788929823.722854:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788929823.722913:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1788929823.722927:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788929823.722930:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788929823.723857:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788929823.723905:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788929823.723958:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788929823.727172:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788929823.727283:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788929823.727363:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788929823.727384:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788929823.727387:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788929823.728287:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788929823.728803:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788929823.728849:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788929823.728937:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788929823.728951:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788929823.728954:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788929823.729621:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788929823.729794:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788929823.729847:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788929823.730112:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788929823.730154:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788929823.730200:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:2.0:1788929823.730218:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788929823.730336:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.730356:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2e99785800/0xce4472dd2237c70a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c703 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.730365:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c72d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.730372:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ec2153800/0xce4472dd2237c75e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c757 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.730395:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c77a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c773 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.730402:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2e99784400/0xce4472dd2237c7ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c7a4 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.730410:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.730447:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2e99784400/0xce4472dd2237c7ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c7a4 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.730463:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2e99784400/0xce4472dd2237c7ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c7a4 expref: 16 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929823.730476:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770092288:0@lo:104: 00000100:00100000:2.0:1788929823.730612:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788929823.730809:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c77a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c773 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.730817:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c77a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c773 expref: 16 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929823.730826:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fe300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770092416:0@lo:104: 00010000:00010000:2.0:1788929823.730851:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ec2153800/0xce4472dd2237c75e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c757 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.730858:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ec2153800/0xce4472dd2237c75e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c757 expref: 16 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929823.730877:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770092544:0@lo:104: 00010000:00010000:2.0:1788929823.730899:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c72d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.730906:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c734 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c72d expref: 16 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929823.730913:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770092672:0@lo:104: 00010000:00010000:2.0:1788929823.730934:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2e99785800/0xce4472dd2237c70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c703 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.730941:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2e99785800/0xce4472dd2237c70a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c703 expref: 16 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929823.730948:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770092800:0@lo:104: 00000100:00100000:2.0:1788929823.730964:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aeba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788929823.731040:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788929823.731060:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929823.731083:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929823.731091:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929823.731098:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929823.731112:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770092288 00000100:00100000:3.0:1788929823.731120:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770092288 00000100:00100000:3.0:1788929823.731156:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770092416 00000100:00100000:3.0:1788929823.731159:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770092416 00000100:00100000:3.0:1788929823.731167:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770092544 00000100:00100000:3.0:1788929823.731168:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770092544 00000100:00100000:3.0:1788929823.731176:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770092672 00000100:00100000:3.0:1788929823.731195:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770092672 00000100:00100000:3.0:1788929823.731208:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770092800 00000100:00100000:3.0:1788929823.731210:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770092800 00000100:00100000:3.0:1788929823.731243:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788929823.731252:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86236050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+7:5834:x1875828770092288:12345-0@lo:104: 00010000:00010000:3.0:1788929823.731266:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c7ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.731427:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788929823.731434:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86236050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+7:5834:x1875828770092288:12345-0@lo:104: Request processed in 184us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.731440:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788929823.731479:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788929823.731485:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+6:5834:x1875828770092416:12345-0@lo:104: 00010000:00010000:3.0:1788929823.731492:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c77a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929823.731612:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770092288:0@lo:104: 00010000:00010000:0.0:1788929823.731795:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788929823.731804:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c7ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.731825:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e80031600 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788929823.731829:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c7ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.731838:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c7ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788929823.731845:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c7ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929823.731851:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788929823.731880:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c7ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.731886:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788929823.731903:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c7ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.731909:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e80031600/0xce4472dd2237c7a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c7ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.731922:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929823.731924:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929823.731926:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929823.732012:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788929823.732026:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770092928:0@lo:103: 00000100:00100000:1.0:1788929823.732063:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788929823.732158:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788929823.732164:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+6:5834:x1875828770092416:12345-0@lo:104: Request processed in 679us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.732172:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788929823.732196:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788929823.732204:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+5:5834:x1875828770092544:12345-0@lo:104: 00010000:00010000:3.0:1788929823.732212:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c75e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929823.732282:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fe300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770092416:0@lo:104: 00000100:00100000:2.0:1788929823.732292:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770092544:0@lo:104: 00000100:00100000:0.0:1788929823.732364:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770092928 00000100:00100000:0.0:1788929823.732370:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770092928 00010000:00010000:0.0:1788929823.732390:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2e99784400/0xce4472dd2237c7ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c7a4 expref: 17 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929823.732424:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788929823.732438:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:3310:x1875828770092928:12345-0@lo:103: 00010000:00010000:0.0:1788929823.732450:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929823.732457:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2e99784400/0xce4472dd2237c7ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c7a4 expref: 17 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.732468:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2e99784400/0xce4472dd2237c7ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c7a4 expref: 17 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.732482:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e99784400/0xce4472dd2237c7ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c7a4 expref: 17 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.732494:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788929823.732603:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788929823.732609:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c77a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.732615:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784c00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788929823.732619:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c77a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.732754:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788929823.732760:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+5:5834:x1875828770092544:12345-0@lo:104: Request processed in 558us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.732775:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788929823.732789:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788929823.732795:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+4:5834:x1875828770092672:12345-0@lo:104: 00010000:00010000:3.0:1788929823.732804:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c734 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.732839:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788929823.732844:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+4:5834:x1875828770092672:12345-0@lo:104: Request processed in 49us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.732849:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788929823.732862:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788929823.732868:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:5834:x1875828770092800:12345-0@lo:104: 00010000:00010000:3.0:1788929823.732875:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c70a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.732898:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788929823.732903:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:5834:x1875828770092800:12345-0@lo:104: Request processed in 37us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.732908:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788929823.733085:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c77a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788929823.733100:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c77a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929823.733105:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788929823.733139:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c77a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.733145:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788929823.733164:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c77a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.733171:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c773 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c77a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.733196:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788929823.733200:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c75e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.733205:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784200 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788929823.733208:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c75e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.733216:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c75e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929823.733219:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3310:x1875828770092928:12345-0@lo:103: Request processed in 779us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929823.733252:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:00010000:1.0:1788929823.733397:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c75e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929823.733402:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788929823.733424:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c75e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.733429:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788929823.733435:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c75e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.733615:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788929823.733753:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99784200/0xce4472dd2237c757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c75e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.733765:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788929823.733768:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c70a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.733773:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785a00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788929823.733776:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c70a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.733783:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c70a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788929823.733789:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c70a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929823.733794:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788929823.733815:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c70a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.733821:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788929823.733830:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c703 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c70a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.733845:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c70a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.733856:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929823.733858:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929823.733859:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929823.733875:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770093056:0@lo:103: 00000100:00100000:1.0:1788929823.733919:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929823.733963:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788929823.733969:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770093184:0@lo:103: 00000100:00100000:1.0:1788929823.733995:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929823.734037:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770093056 00000100:00100000:1.0:1788929823.734044:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770093056 00010000:00010000:1.0:1788929823.734066:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c77a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c773 expref: 16 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929823.734088:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770093184 00000100:00100000:1.0:1788929823.734091:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770093184 00010000:00010000:1.0:1788929823.734102:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ec2153800/0xce4472dd2237c75e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c757 expref: 17 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929823.734115:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788929823.734122:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:3308:x1875828770093056:12345-0@lo:103: 00010000:00010000:1.0:1788929823.734133:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929823.734138:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c77a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c773 expref: 17 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.734149:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c77a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c773 expref: 17 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929823.734166:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1788929823.734170:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c77a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c773 expref: 17 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929823.734175:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770093312:0@lo:103: 00010000:00010000:1.0:1788929823.734195:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929823.734215:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929823.734241:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3308:x1875828770093056:12345-0@lo:103: Request processed in 103us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929823.734248:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788929823.734261:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770093312 00000100:00100000:1.0:1788929823.734264:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770093312 00000100:00100000:3.0:1788929823.734288:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770092672:0@lo:104: 00000100:00100000:3.0:1788929823.734298:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5834:1875828770092800:0@lo:104: 00010000:00010000:3.0:1788929823.734329:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929823.734530:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788929823.734539:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3308:x1875828770093184:12345-0@lo:103: 00010000:00010000:0.0:1788929823.734552:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929823.734557:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ec2153800/0xce4472dd2237c75e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c757 expref: 16 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.734559:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2e99785800/0xce4472dd2237c70a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c703 expref: 16 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.734567:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ec2153800/0xce4472dd2237c75e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c757 expref: 16 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929823.734573:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1788929823.734577:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2153800/0xce4472dd2237c75e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c757 expref: 16 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929823.734579:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788929823.734586:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929823.734588:0:5824:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788929823.734594:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788929823.734600:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:3311:x1875828770093312:12345-0@lo:103: 00010000:00010000:1.0:1788929823.734606:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788929823.734609:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:3308:x1875828770093184:12345-0@lo:103: Request processed in 73us (618us total) trans 0 rc 0/0 00010000:00010000:1.0:1788929823.734610:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2e99785800/0xce4472dd2237c70a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c703 expref: 15 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.734619:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2e99785800/0xce4472dd2237c70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c703 expref: 15 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.734628:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e99785800/0xce4472dd2237c70a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c703 expref: 15 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.734638:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929823.734665:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:3311:x1875828770093312:12345-0@lo:103: Request processed in 65us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929823.734850:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788929823.734866:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788929823.734890:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770093312:0@lo:103: 00000100:00100000:1.0:1788929823.734918:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770092928:0@lo:103: 00000100:00100000:1.0:1788929823.734938:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770093184:0@lo:103: 00000100:00100000:1.0:1788929823.734944:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770093056:0@lo:103: 00010000:00010000:3.0:1788929823.735218:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929823.735386:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929823.735389:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929823.735430:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c734 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.735438:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784000 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788929823.735442:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c734 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.735450:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c734 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788929823.735456:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c734 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929823.735462:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788929823.735750:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c734 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.735758:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788929823.735783:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c734 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.735790:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c72d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c734 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.735804:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929823.735805:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929823.735807:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929823.735849:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770093440:0@lo:103: 00000100:00100000:3.0:1788929823.735891:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929823.735968:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770093440 00000100:00100000:1.0:1788929823.735974:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770093440 00010000:00010000:1.0:1788929823.735996:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c734 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c72d expref: 13 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929823.736025:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788929823.736033:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:3311:x1875828770093440:12345-0@lo:103: 00010000:00010000:1.0:1788929823.736058:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929823.736070:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c734 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c72d expref: 13 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.736080:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c72d expref: 13 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.736090:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c734 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c72d expref: 13 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.736102:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.736112:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.736126:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.736134:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.736141:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.736147:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.736153:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ea3c53c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788929823.736156:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.736163:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.736192:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.736203:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929823.736260:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:3311:x1875828770093440:12345-0@lo:103: Request processed in 229us (369us total) trans 0 rc 0/0 00010000:00010000:3.0:1788929823.736358:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.736367:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.736375:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ea3c53c00/0xce4472dd2237c7c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788929823.736387:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788929823.736987:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788929823.737027:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770093440:0@lo:103: 00000100:00100000:3.0:1788929823.775016:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:7622:x1875828770092160:12345-0@lo:253: Request processed in 66043us (67878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.775033:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788929823.775149:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770092160:0@lo:253: 10000000:01000000:1.0:1788929823.775165:0:7622:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788929823.775169:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788929823.775171:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788929823.775173:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788929823.775174:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788929823.775176:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788929823.775187:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788929823.775189:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788929823.775190:0:7622:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788929823.775192:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788929823.775193:0:7622:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788929823.775213:0:7622:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2d85d86800 from lustre-OST0001 10000000:01000000:1.0:1788929823.775292:0:7622:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788929823.775296:0:7622:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788929823.775306:0:7622:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2e8637b380 local copy 10000000:01000000:1.0:1788929823.775311:0:7622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788929823.775353:0:7622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.775366:0:7622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.775396:0:7622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929823.775418:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770093568:0@lo:101: 00000100:00100000:1.0:1788929823.775457:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929823.775493:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9810bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788929823.775553:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770093568 00000100:00100000:2.0:1788929823.775560:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770093568 00000100:00100000:2.0:1788929823.775606:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788929823.775615:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+11:7622:x1875828770093568:12345-0@lo:101: 00010000:00010000:2.0:1788929823.775627:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929823.775639:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ea3c52800/0xce4472dd2237c7d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c7ce expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.775673:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ea3c52800/0xce4472dd2237c7d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c7ce expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.775684:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ea3c52800/0xce4472dd2237c7d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c7ce expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.775693:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ea3c52800, rc 0) 00000100:00100000:2.0:1788929823.775724:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:7622:x1875828770093568:12345-0@lo:101: Request processed in 110us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929823.775730:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788929823.775806:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770093568:0@lo:101: 00010000:00010000:1.0:1788929823.775819:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xce4472dd2237c7d5 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.775828:0:7622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xce4472dd2237c7d5 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929823.775919:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770093696:0@lo:501: 00000100:00100000:1.0:1788929823.775945:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929823.775967:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9810bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788929823.776270:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770093696 00000100:00100000:2.0:1788929823.776275:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770093696 00000100:00100000:2.0:1788929823.776305:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788929823.776312:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:7622:x1875828770093696:12345-0@lo:501: 00000100:00100000:2.0:1788929823.776513:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:7622:x1875828770093696:12345-0@lo:501: Request processed in 200us (566us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788929823.776521:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788929823.776594:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770093696:0@lo:501: 10000000:01000000:1.0:1788929823.776609:0:7622:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788929823.776646:0:7622:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788929823.776652:0:7622:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xce4472dd2237c7d5 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.776661:0:7622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xce4472dd2237c7d5 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.776669:0:7622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xce4472dd2237c7d5 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.776699:0:7622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788929823.776717:0:7622:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2d85d86800 10000000:01000000:1.0:1788929823.776721:0:7622:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788929823.776725:0:7622:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788929823.776733:0:7622:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788929823.776738:0:7622:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788929823.776740:0:7622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788929823.776759:0:7622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.776767:0:7622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.776775:0:7622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929823.776789:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770093824:0@lo:101: 00000100:00100000:1.0:1788929823.776814:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929823.776847:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9810b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788929823.776860:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770093824 00000100:00100000:0.0:1788929823.776866:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770093824 00000100:00100000:0.0:1788929823.776905:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788929823.776912:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:7622:x1875828770093824:12345-0@lo:101: 00010000:00010000:0.0:1788929823.776920:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929823.776932:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e80031600/0xce4472dd2237c7e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c7dc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.776951:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e80031600/0xce4472dd2237c7e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c7dc expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.776961:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e80031600/0xce4472dd2237c7e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c7dc expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.776979:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e80031600, rc 0) 00000100:00100000:0.0:1788929823.777010:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770093824:12345-0@lo:101: Request processed in 99us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929823.777015:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788929823.777101:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770093824:0@lo:101: 00010000:00010000:1.0:1788929823.777111:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c7e3 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.777119:0:7622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c7e3 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929823.777172:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770093952:0@lo:501: 00000100:00100000:1.0:1788929823.777214:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929823.777267:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9810b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788929823.777313:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770093952 00000100:00100000:0.0:1788929823.777317:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770093952 00000100:00100000:0.0:1788929823.777335:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788929823.777340:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770093952:12345-0@lo:501: 00000100:00100000:0.0:1788929823.777515:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770093952:12345-0@lo:501: Request processed in 173us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929823.777521:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788929823.777601:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770093952:0@lo:501: 00000100:00100000:1.0:1788929823.777630:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094080:0@lo:503: 00000100:00100000:1.0:1788929823.777665:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788929823.777667:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788929823.777678:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xce4472dd2237c7d5 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.777686:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784000 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:2.0:1788929823.777690:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xce4472dd2237c7d5 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.777699:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xce4472dd2237c7d5 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788929823.777721:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xce4472dd2237c7d5 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788929823.777727:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788929823.777731:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9810b480 going to sleep for 11 seconds 00010000:00010000:2.0:1788929823.777751:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xce4472dd2237c7d5 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.777759:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788929823.777783:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xce4472dd2237c7d5 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.777791:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c7ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xce4472dd2237c7d5 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.777804:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929823.777806:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929823.777807:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929823.777894:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788929823.777905:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770094208:0@lo:103: 00000100:00100000:1.0:1788929823.777935:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929823.778013:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770094208 00000100:00100000:2.0:1788929823.778018:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770094208 00000100:00100000:2.0:1788929823.778053:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788929823.778060:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:3309:x1875828770094208:12345-0@lo:103: 00010000:00010000:2.0:1788929823.778071:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929823.778084:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ea3c52800/0xce4472dd2237c7d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237c7ce expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.778096:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929823.778139:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:3309:x1875828770094208:12345-0@lo:103: Request processed in 79us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929823.778145:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788929823.778435:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770094208:0@lo:103: 00000100:00100000:0.0:1788929823.778645:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770094080 00000100:00100000:0.0:1788929823.778650:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770094080 00000100:00100000:2.0:1788929823.778861:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788929823.778869:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:7622:x1875828770094080:12345-0@lo:503: 00000100:00100000:2.0:1788929823.779029:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:7622:x1875828770094080:12345-0@lo:503: Request processed in 161us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929823.779036:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788929823.779125:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094080:0@lo:503: 00000040:00080000:1.0:1788929823.779515:0:7622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788929823.779603:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094336:0@lo:502: 00000100:00100000:1.0:1788929823.779639:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929823.779665:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9810b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788929823.779727:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770094336 00000100:00100000:2.0:1788929823.779733:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770094336 00000100:00100000:2.0:1788929823.779751:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788929823.779757:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:7622:x1875828770094336:12345-0@lo:502: 00000100:00100000:2.0:1788929823.779883:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:7622:x1875828770094336:12345-0@lo:502: Request processed in 126us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929823.779889:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788929823.779959:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094336:0@lo:502: 00000040:00080000:1.0:1788929823.780215:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788929823.780341:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788929823.780373:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788929823.780427:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788929823.780461:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788929823.780497:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788929823.780519:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094464:0@lo:502: 00000100:00100000:1.0:1788929823.780555:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929823.780618:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9810b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788929823.780770:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770094464 00000100:00100000:2.0:1788929823.780775:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770094464 00000100:00100000:2.0:1788929823.780807:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788929823.780814:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:7622:x1875828770094464:12345-0@lo:502: 00000100:00100000:2.0:1788929823.780948:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:7622:x1875828770094464:12345-0@lo:502: Request processed in 134us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929823.780953:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788929823.781024:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094464:0@lo:502: 00000040:00080000:1.0:1788929823.781101:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788929823.781112:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788929823.781821:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788929823.781832:0:7630:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788929823.781840:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929823.781843:0:7630:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788929823.781850:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788929823.781872:0:7630:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d2eb5b8cd40) 00000020:00000080:3.0:1788929823.781894:0:7630:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788929823.781903:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788929823.781972:0:7630:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2d85d86800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788929823.781979:0:7630:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788929823.781988:0:7630:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xce4472dd2237c7f1 00010000:00010000:3.0:1788929823.786123:0:7630:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788929823.786508:0:7630:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788929823.792047:0:7630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788929823.792485:0:7630:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788929823.797912:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788929823.798983:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788929823.801131:0:7630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788929823.801146:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788929823.801153:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929823.801155:0:7630:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788929823.801158:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788929823.801163:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929823.801164:0:7630:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788929823.801167:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788929823.801169:0:7630:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788929823.801275:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788929823.801280:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929823.801282:0:7630:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788929823.801285:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788929823.801514:0:7622:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788929823.801543:0:7622:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788929823.801581:0:7622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c7e3 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.801595:0:7622:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c7e3 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929823.801604:0:7622:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2d85d86800 from 1 10000000:01000000:1.0:1788929823.801606:0:7622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788929823.801641:0:7622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.801650:0:7622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.801661:0:7622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929823.801687:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094592:0@lo:101: 00000100:00100000:1.0:1788929823.801763:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929823.801807:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9810bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788929823.801842:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770094592 00000100:00100000:1.0:1788929823.801851:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770094592 00000100:00100000:1.0:1788929823.801896:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788929823.801907:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:7622:x1875828770094592:12345-0@lo:101: 00010000:00010000:1.0:1788929823.801922:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929823.801942:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e99784200/0xce4472dd2237c7ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c7f8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.801968:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e99784200/0xce4472dd2237c7ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c7f8 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.801979:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e99784200/0xce4472dd2237c7ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c7f8 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.801988:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99784200, rc 0) 00000100:00100000:1.0:1788929823.802026:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770094592:12345-0@lo:101: Request processed in 121us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929823.802032:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788929823.802079:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094592:0@lo:101: 00010000:00010000:1.0:1788929823.802095:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c7ff expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.802103:0:7622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c7ff expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929823.802697:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094720:0@lo:501: 00000100:00100000:1.0:1788929823.802736:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929823.802773:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9acd2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788929823.802912:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770094720 00000100:00100000:3.0:1788929823.802917:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770094720 00000100:00100000:3.0:1788929823.802950:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788929823.802958:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770094720:12345-0@lo:501: 00000100:00100000:3.0:1788929823.803251:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770094720:12345-0@lo:501: Request processed in 293us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.803259:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788929823.803414:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094720:0@lo:501: 00000100:00100000:3.0:1788929823.803446:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094848:0@lo:503: 00000100:00100000:3.0:1788929823.803483:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929823.803700:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d66cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929823.803727:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770094848 00000100:00100000:3.0:1788929823.803732:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770094848 00000100:00100000:3.0:1788929823.803755:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788929823.803762:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770094848:12345-0@lo:503: 00000100:00100000:3.0:1788929823.804100:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770094848:12345-0@lo:503: Request processed in 338us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.804108:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788929823.804136:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094848:0@lo:503: 00000040:00080000:0.0:1788929823.804473:0:7622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788929823.804547:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094976:0@lo:502: 00000100:00100000:0.0:1788929823.804594:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929823.804616:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90286b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788929823.805427:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770094976 00000100:00100000:3.0:1788929823.805435:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770094976 00000100:00100000:3.0:1788929823.805471:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788929823.805479:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770094976:12345-0@lo:502: 00000100:00100000:3.0:1788929823.805783:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770094976:12345-0@lo:502: Request processed in 304us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.805791:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788929823.805847:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770094976:0@lo:502: 00000040:00080000:3.0:1788929823.806151:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788929823.806213:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788929823.807916:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770095104:0@lo:502: 00000100:00100000:3.0:1788929823.807996:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929823.808666:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d66600 going to sleep for 11 seconds 00000100:00100000:0.0:1788929823.808935:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770095104 00000100:00100000:0.0:1788929823.808944:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770095104 00000100:00100000:0.0:1788929823.809025:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788929823.809036:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770095104:12345-0@lo:502: 00000100:00100000:0.0:1788929823.809347:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770095104:12345-0@lo:502: Request processed in 312us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929823.809355:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788929823.810609:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770095104:0@lo:502: 00000040:00080000:2.0:1788929823.811193:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788929823.811209:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788929823.812681:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788929823.812694:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929823.812697:0:7634:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788929823.812705:0:7634:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2d85d86800 00000020:00000080:3.0:1788929823.812707:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788929823.812727:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788929823.812730:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929823.812731:0:7634:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788929823.812734:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788929823.812895:0:7622:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788929823.812923:0:7622:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788929823.812976:0:7622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c7ff expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.813001:0:7622:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c7ff expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788929823.813043:0:7622:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788929823.813046:0:7622:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2d85d86800 10000000:01000000:2.0:1788929823.813048:0:7622:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2d85d86800 10000000:01000000:2.0:1788929823.813052:0:7622:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788929823.813057:0:7622:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2d85d86800 from 1 10000000:01000000:2.0:1788929823.813059:0:7622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788929823.813158:0:7622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.813167:0:7622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.813194:0:7622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929823.813219:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770095232:0@lo:101: 00000100:00100000:2.0:1788929823.813460:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929823.813532:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aeba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788929823.813829:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770095232 00000100:00100000:3.0:1788929823.813836:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770095232 00000100:00100000:3.0:1788929823.813918:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788929823.813928:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770095232:12345-0@lo:101: 00010000:00010000:3.0:1788929823.813941:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929823.813954:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237c80d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c806 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.813978:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237c80d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c806 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.813988:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237c80d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c806 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.813997:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152600, rc 0) 00000100:00100000:3.0:1788929823.814091:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7622:x1875828770095232:12345-0@lo:101: Request processed in 164us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.814098:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788929823.814334:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770095232:0@lo:101: 00010000:00010000:2.0:1788929823.814351:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c80d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.814360:0:7622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c80d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929823.814470:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770095360:0@lo:501: 00000100:00100000:2.0:1788929823.814563:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929823.814636:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aeba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788929823.814687:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770095360 00000100:00100000:3.0:1788929823.814692:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770095360 00000100:00100000:3.0:1788929823.814725:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788929823.814731:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7622:x1875828770095360:12345-0@lo:501: 00000100:00100000:3.0:1788929823.814986:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7622:x1875828770095360:12345-0@lo:501: Request processed in 254us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.814992:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788929823.815060:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770095360:0@lo:501: 00000100:00100000:2.0:1788929823.815158:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770095488:0@lo:503: 00000100:00100000:2.0:1788929823.815210:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929823.815260:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aeba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788929823.815266:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770095488 00000100:00100000:1.0:1788929823.815273:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770095488 00000100:00100000:1.0:1788929823.815569:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788929823.815581:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7622:x1875828770095488:12345-0@lo:503: 00000100:00100000:1.0:1788929823.815879:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7622:x1875828770095488:12345-0@lo:503: Request processed in 300us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929823.815897:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788929823.820208:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770095488:0@lo:503: 00000040:00080000:2.0:1788929823.821019:0:7622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788929823.821110:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770095616:0@lo:502: 00000100:00100000:2.0:1788929823.821449:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929823.821733:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84a76e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788929823.822314:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770095616 00000100:00100000:3.0:1788929823.822323:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770095616 00000100:00100000:3.0:1788929823.822364:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788929823.822373:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7622:x1875828770095616:12345-0@lo:502: 00000100:00100000:3.0:1788929823.822782:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7622:x1875828770095616:12345-0@lo:502: Request processed in 408us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.822791:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788929823.822900:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770095616:0@lo:502: 00000040:00080000:1.0:1788929823.823317:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788929823.823377:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788929823.823422:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788929823.823487:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788929823.823537:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788929823.823594:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788929823.824156:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788929823.824328:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788929823.824386:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788929823.824421:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788929823.824454:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788929823.824504:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788929823.825004:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788929823.825036:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788929823.825189:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788929823.825322:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788929823.825365:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788929823.825413:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788929823.825450:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788929823.825485:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788929823.825599:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788929823.825707:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788929823.825745:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788929823.825809:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788929823.825973:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788929823.826008:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788929823.826122:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788929823.826162:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788929823.826209:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788929823.826402:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788929823.826441:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788929823.826475:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788929823.826555:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788929823.826613:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788929823.826719:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788929823.826782:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788929823.826820:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788929823.826987:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770095744:0@lo:502: 00000100:00100000:1.0:1788929823.827137:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929823.827202:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9acd26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929823.827997:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770095744 00000100:00100000:0.0:1788929823.828020:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770095744 00000100:00100000:0.0:1788929823.828080:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788929823.828089:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7622:x1875828770095744:12345-0@lo:502: 00000100:00100000:0.0:1788929823.828595:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7622:x1875828770095744:12345-0@lo:502: Request processed in 506us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929823.828605:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788929823.829034:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770095744:0@lo:502: 00000040:00080000:1.0:1788929823.829146:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788929823.829159:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788929823.831771:0:7635:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788929823.831795:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d2ebccd19c0) 00000020:00000080:1.0:1788929823.831817:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788929823.831887:0:7635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2d85d86800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788929823.831891:0:7635:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2d85d86800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788929823.831893:0:7635:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2d85d86800 3 00010000:00080000:1.0:1788929823.831923:0:7635:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2d85d87800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.140@tcp at head 00010000:00010000:1.0:1788929823.835778:0:7635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788929823.836010:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788929823.836049:0:7635:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788929823.836064:0:7635:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xce4472dd2237c81b 00000100:00080000:1.0:1788929823.836143:0:7635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788929823.836156:0:7635:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2d85d87800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788929823.836205:0:7635:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2eb61cce00 x1875828770095872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788929823.836334:0:7635:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788929823.836467:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875828770095872:0@lo:38: 00000100:00100000:0.0:1788929823.836556:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929823.836961:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788929823.836971:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770096000:0@lo:400: 00000100:00100000:3.0:1788929823.837000:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929823.837027:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770096128:0@lo:400: 00000100:00100000:3.0:1788929823.837048:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929823.837063:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788929823.837068:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770096256:0@lo:400: 00000100:00100000:3.0:1788929823.837115:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929823.837153:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770095872 00000100:00100000:3.0:1788929823.837160:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770095872 00000100:00100000:3.0:1788929823.837192:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770096000 00000100:00100000:3.0:1788929823.837195:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770096000 00000100:00100000:3.0:1788929823.837214:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770096128 00000100:00100000:3.0:1788929823.837216:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770096128 00000100:00100000:3.0:1788929823.837379:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788929823.837391:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770096000:12345-0@lo:400: 00000100:00100000:3.0:1788929823.837440:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770096000:12345-0@lo:400: Request processed in 52us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.837447:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788929823.837465:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788929823.837471:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770096128:12345-0@lo:400: 00000100:00100000:3.0:1788929823.837638:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770096128:12345-0@lo:400: Request processed in 166us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.837645:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788929823.837666:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788929823.837670:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875828770095872:12345-0@lo:38: 00010000:00080000:3.0:1788929823.837692:0:5839:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1788929823.837726:0:5839:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xce4472dd2237c822 00000004:00100000:3.0:1788929823.837743:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788929823.837779:0:5839:0:(import.c:65:import_set_state_nolock()) ffff8d2eb5b82800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788929823.837818:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875828770095872:12345-0@lo:38: Request processed in 146us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.837824:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788929823.837849:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770096256 00000100:00100000:3.0:1788929823.837852:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770096256 00000100:00100000:3.0:1788929823.837882:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788929823.837888:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770096256:12345-0@lo:400: 00000100:00100000:3.0:1788929823.837917:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770096256:12345-0@lo:400: Request processed in 29us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.837923:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788929823.837939:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788929823.837943:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788929823.837975:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2eb61cce00 x1875828770095872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788929833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929823.837985:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788929823.837993:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788929823.838001:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788929823.838005:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788929823.838007:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2d85d87800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788929823.838013:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875828770095872:0@lo:38: 00010000:00080000:3.0:1788929823.838045:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2e90314700 x1875828770096000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929823.838060:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770096000:0@lo:400: 00000040:00080000:1.0:1788929823.838354:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:3.0:1788929823.839124:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2e90315f80 x1875828770096256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929823.839136:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770096256:0@lo:400: 00010000:00080000:3.0:1788929823.839148:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2e90315180 x1875828770096128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929823.839156:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770096128:0@lo:400: 00000100:00100000:0.0:1788929823.839370:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7636:1875828770096384:0@lo:901: 00000100:00100000:0.0:1788929823.839416:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929823.839446:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84b1f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929823.839702:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770096384 00000100:00100000:3.0:1788929823.839709:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770096384 00000100:00100000:3.0:1788929823.839760:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788929823.839768:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7636:x1875828770096384:12345-0@lo:901: 00000100:00100000:3.0:1788929823.840398:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7636:x1875828770096384:12345-0@lo:901: Request processed in 629us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.840406:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788929823.840487:0:7636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2ebbffaa00 x1875828770096384/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788929839 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929823.840515:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7636:1875828770096384:0@lo:901: 00000100:00080000:1.0:1788929823.843812:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:0.0:1788929823.843983:0:7622:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788929823.844026:0:7622:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788929823.844057:0:7622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c80d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.844145:0:7622:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c80d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788929823.844242:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788929823.844245:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788929823.844247:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788929823.844249:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788929823.844250:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788929823.844251:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788929823.844253:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788929823.844261:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788929823.844263:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788929823.844440:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788929823.844442:0:7622:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788929823.844446:0:7622:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788929823.844449:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788929823.844450:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788929823.844451:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788929823.844452:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788929823.844453:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788929823.844455:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788929823.844456:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788929823.844457:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788929823.844458:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788929823.844459:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788929823.844460:0:7622:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788929823.844489:0:7622:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788929823.844575:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770096512:0@lo:253: 00000100:00100000:0.0:1788929823.844645:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929823.844691:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5a35180 going to sleep for 11 seconds 00000100:00100000:1.0:1788929823.844807:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770096512 00000100:00100000:1.0:1788929823.844815:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770096512 00000100:00100000:1.0:1788929823.844865:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788929823.844873:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7622:x1875828770096512:12345-0@lo:253: 20000000:01000000:1.0:1788929823.844899:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788929823.844914:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788929823.893679:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788929823.893704:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788929823.894207:0:5855:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788929823.894212:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788929823.894269:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.894287:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ec2152200/0xce4472dd2237c76c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c765 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.894296:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.894333:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ec2152200/0xce4472dd2237c76c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c765 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929823.894346:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ec2152200/0xce4472dd2237c76c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c765 expref: 14 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929823.894373:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875828770096640:0@lo:104: 00000100:00100000:2.0:1788929823.894432:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929823.894464:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d666c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929823.894564:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770096640 00000100:00100000:0.0:1788929823.894572:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770096640 00000100:00100000:0.0:1788929823.894617:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788929823.894626:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:5855:x1875828770096640:12345-0@lo:104: 00010000:00010000:0.0:1788929823.894638:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c76c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929823.894689:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788929823.894695:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:5855:x1875828770096640:12345-0@lo:104: Request processed in 71us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929823.894702:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5855:1875828770096640:0@lo:104: 00000100:00100000:0.0:1788929823.894704:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788929823.894727:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.894814:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788929823.894820:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c76c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.894828:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e80031c00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:3.0:1788929823.894831:0:7628:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c76c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.894840:0:7628:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c76c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788929823.894853:0:7628:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c76c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788929823.894859:0:7628:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788929823.894893:0:7628:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c76c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.894899:0:7628:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788929823.894919:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c76c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.894926:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c765 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c76c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.894942:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929823.894944:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929823.894947:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929823.896448:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788929823.896482:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770096768:0@lo:103: 00000100:00100000:0.0:1788929823.896561:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929823.896679:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770096768 00000100:00100000:3.0:1788929823.896687:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770096768 00010000:00010000:3.0:1788929823.896723:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ec2152200/0xce4472dd2237c76c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c765 expref: 15 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929823.896760:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788929823.896771:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:3309:x1875828770096768:12345-0@lo:103: 00010000:00010000:3.0:1788929823.896784:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929823.896788:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ec2152200/0xce4472dd2237c76c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c765 expref: 15 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.896800:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ec2152200/0xce4472dd2237c76c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c765 expref: 15 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.896825:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2152200/0xce4472dd2237c76c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c765 expref: 15 pid: 5833 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.896841:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.896850:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788929823.896864:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002652538s 00010000:00010000:3.0:1788929823.896869:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.896876:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.896883:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.896890:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.896896:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ea3c53400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788929823.896900:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.896906:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.896929:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929823.896951:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788929823.896966:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.896978:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929823.896995:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ea3c53400/0xce4472dd2237c829 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929823.897000:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:3309:x1875828770096768:12345-0@lo:103: Request processed in 230us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.897012:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788929823.897608:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770096768:0@lo:103: 00000100:00100000:3.0:1788929823.904353:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:7622:x1875828770096512:12345-0@lo:253: Request processed in 59461us (59689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929823.904377:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788929823.904770:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bddba76f-ee04-4b28-985b-cc9b0811bff7:7622:1875828770096512:0@lo:253: 10000000:01000000:0.0:1788929823.904788:0:7622:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788929823.904791:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788929823.904793:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788929823.904794:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788929823.904795:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788929823.904796:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788929823.904797:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788929823.904799:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788929823.904800:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788929823.904801:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788929823.904803:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788929823.904804:0:7622:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788929823.904817:0:7622:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788929823.918127:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788929823.918609:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788929823.918890:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788929823.922259:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788929823.922960:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788929823.924900:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788929823.927800:0:7622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1788929824.155877:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788929824.182574:0:7622:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788929824.182584:0:7622:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788929824.182696:0:7622:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788929824.182757:0:7622:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788929824.182773:0:7622:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788929824.182804:0:7622:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788929825.180570:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929826.205265:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929826.780437:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770096896:0@lo:13: 00000100:00100000:2.0:1788929826.780581:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929826.780700:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770096896 00000100:00100000:3.0:1788929826.780709:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770096896 00000100:00100000:3.0:1788929826.780781:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788929826.780791:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770096896:12345-0@lo:13: 00002000:00000024:3.0:1788929826.780825:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929826.780870:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770096896:12345-0@lo:13: Request processed in 81us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929826.780877:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788929826.780990:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788929826.781135:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85551180 x1875828770096896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929826.781156:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770096896:0@lo:13: 00010000:00010000:1.0:1788929827.227607:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929828.254281:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929829.277869:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929829.340387:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770097280:0@lo:400: 00000100:00100000:3.0:1788929829.340463:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929829.340595:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788929829.340603:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770097408:0@lo:400: 00000100:00100000:3.0:1788929829.340631:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929829.340665:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770097152:0@lo:400: 00000100:00100000:3.0:1788929829.340692:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929829.340705:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770097024:0@lo:400: 00000100:00100000:1.0:1788929829.340773:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929829.340808:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770097536:0@lo:400: 00000100:00100000:0.0:1788929829.341158:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770097280 00000100:00100000:0.0:1788929829.341169:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770097280 00000100:00100000:0.0:1788929829.341221:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770097408 00000100:00100000:0.0:1788929829.341242:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770097408 00000100:00100000:0.0:1788929829.341288:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788929829.341297:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770097408:12345-0@lo:400: 00000100:00100000:0.0:1788929829.341349:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770097408:12345-0@lo:400: Request processed in 53us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929829.341357:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788929829.341380:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770097024 00000100:00100000:0.0:1788929829.341383:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770097024 00000100:00100000:0.0:1788929829.341408:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788929829.341414:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:3310:x1875828770097024:12345-0@lo:400: 00000100:00100000:0.0:1788929829.341443:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:3310:x1875828770097024:12345-0@lo:400: Request processed in 30us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929829.341460:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788929829.341484:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788929829.341628:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770097152 00000100:00100000:3.0:1788929829.341633:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770097152 00000100:00100000:3.0:1788929829.341666:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788929829.341674:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770097152:12345-0@lo:400: 00000100:00100000:1.0:1788929829.341774:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929829.341827:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770097152:12345-0@lo:400: Request processed in 152us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.341835:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788929829.341850:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770097536 00000100:00100000:3.0:1788929829.341854:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770097536 00000100:00100000:3.0:1788929829.341879:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788929829.341884:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770097536:12345-0@lo:400: 00010000:00080000:0.0:1788929829.342094:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb61ced80 x1875828770097408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929829.342108:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770097408:0@lo:400: 00000100:00100000:3.0:1788929829.342144:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770097536:12345-0@lo:400: Request processed in 259us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.342152:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788929829.342183:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb61cc380 x1875828770097152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929829.342193:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770097152:0@lo:400: 00010000:00080000:1.0:1788929829.342454:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb61cca80 x1875828770097536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929829.342465:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770097536:0@lo:400: 00000100:00100000:1.0:1788929829.342486:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770097024:0@lo:400: 00000100:00080000:0.0:1788929829.342635:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929829.342753:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788929829.342809:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929829.342831:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770097280:12345-0@lo:400: 00000100:00100000:0.0:1788929829.342887:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770097280:12345-0@lo:400: Request processed in 126us (2423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929829.342894:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788929829.343481:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb61cdf80 x1875828770097280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929829.343492:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770097280:0@lo:400: 10000000:01000000:3.0:1788929829.852671:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788929829.852680:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2eb5357800 from 30 10000000:01000000:3.0:1788929829.853244:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788929829.853295:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.853308:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.853321:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929829.853342:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85553b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770097664:0@lo:101: 00000100:00100000:3.0:1788929829.853420:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929829.853467:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788929829.853862:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770097664 00000100:00100000:2.0:1788929829.853871:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770097664 00000100:00100000:2.0:1788929829.853928:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788929829.853937:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:5837:x1875828770097664:12345-0@lo:101: 00010000:00010000:2.0:1788929829.853950:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929829.853962:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c830 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.853986:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c830 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.853996:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c830 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.854015:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ea3c53800, rc 0) 00000100:00100000:2.0:1788929829.854060:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770097664:12345-0@lo:101: Request processed in 124us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929829.854076:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788929829.854205:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85553b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770097664:0@lo:101: 00010000:00010000:1.0:1788929829.854248:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c837 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929829.854260:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c837 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929829.854334:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770097792:0@lo:501: 00000100:00100000:1.0:1788929829.854370:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929829.854399:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770097792 00000100:00100000:0.0:1788929829.854405:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770097792 00000100:00100000:0.0:1788929829.854431:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788929829.854438:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770097792:12345-0@lo:501: 00000100:00100000:1.0:1788929829.854641:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788929829.856960:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770097792:12345-0@lo:501: Request processed in 2511us (2579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929829.856974:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788929829.857381:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770097792:0@lo:501: 00000100:00100000:3.0:1788929829.857440:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770097920:0@lo:503: 00000100:00100000:3.0:1788929829.857492:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929829.857527:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788929829.859113:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770097920 00000100:00100000:0.0:1788929829.859127:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770097920 00000100:00100000:0.0:1788929829.859203:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788929829.859215:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770097920:12345-0@lo:503: 00000100:00100000:0.0:1788929829.861864:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770097920:12345-0@lo:503: Request processed in 2641us (4360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929829.861881:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788929829.861911:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770097920:0@lo:503: 00000100:00100000:3.0:1788929829.864441:0:7922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7922:1875828770098048:0@lo:502: 00000100:00100000:3.0:1788929829.864543:0:7922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929829.864587:0:7922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929829.864712:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770098048 00000100:00100000:0.0:1788929829.864729:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770098048 00000100:00100000:0.0:1788929829.864791:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788929829.864801:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7922:x1875828770098048:12345-0@lo:502: 00000100:00100000:0.0:1788929829.865596:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7922:x1875828770098048:12345-0@lo:502: Request processed in 793us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929829.865607:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788929829.865636:0:7922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7922:1875828770098048:0@lo:502: 00000100:00100000:1.0:1788929829.865770:0:7922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7922:1875828770098176:0@lo:502: 00000100:00100000:1.0:1788929829.865816:0:7922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929829.865857:0:7922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788929829.865906:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770098176 00000100:00100000:3.0:1788929829.865912:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770098176 00000100:00100000:3.0:1788929829.865949:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788929829.865957:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7922:x1875828770098176:12345-0@lo:502: 00000100:00100000:3.0:1788929829.866137:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:7922:x1875828770098176:12345-0@lo:502: Request processed in 180us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.866144:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788929829.866305:0:7922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7922:1875828770098176:0@lo:502: 00000040:00080000:1.0:1788929829.866325:0:7922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788929829.866386:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788929829.866405:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788929829.866416:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c837 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929829.866428:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c837 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929829.866439:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788929829.866442:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788929829.866445:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788929829.866469:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929829.866477:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929829.866486:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929829.867649:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770098304:0@lo:101: 00000100:00100000:1.0:1788929829.868313:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929829.868353:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788929829.872075:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770098304 00000100:00100000:0.0:1788929829.872089:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770098304 00000100:00100000:0.0:1788929829.872151:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788929829.872162:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770098304:12345-0@lo:101: 00010000:00010000:0.0:1788929829.872187:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929829.872208:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c83e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929829.872261:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c83e expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929829.872283:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c83e expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929829.872293:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e80030a00, rc 0) 00000100:00100000:0.0:1788929829.872368:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770098304:12345-0@lo:101: Request processed in 208us (4056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929829.872375:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788929829.872835:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770098304:0@lo:101: 00010000:00010000:1.0:1788929829.872855:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c845 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929829.872867:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c845 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929829.872939:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770098432:0@lo:501: 00000100:00100000:1.0:1788929829.872977:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929829.873019:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788929829.873079:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770098432 00000100:00100000:3.0:1788929829.873084:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770098432 00000100:00100000:3.0:1788929829.873123:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788929829.873132:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770098432:12345-0@lo:501: 00000100:00100000:3.0:1788929829.873474:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770098432:12345-0@lo:501: Request processed in 343us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.873481:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788929829.873856:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770098432:0@lo:501: 00000100:00100000:1.0:1788929829.873891:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770098560:0@lo:503: 00000100:00100000:1.0:1788929829.873932:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929829.873960:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788929829.874123:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770098560 00000100:00100000:3.0:1788929829.874129:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770098560 00000100:00100000:3.0:1788929829.877375:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788929829.877413:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770098560:12345-0@lo:503: 00000100:00100000:3.0:1788929829.877926:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770098560:12345-0@lo:503: Request processed in 525us (3991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.877934:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788929829.885950:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770098560:0@lo:503: 00000100:00100000:1.0:1788929829.894364:0:7925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7925:1875828770098688:0@lo:502: 00000100:00100000:1.0:1788929829.894716:0:7925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929829.894916:0:7925:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5000 going to sleep for 11 seconds 00000100:00100000:2.0:1788929829.901909:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770098688 00000100:00100000:2.0:1788929829.901929:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770098688 00000100:00100000:1.0:1788929829.902098:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788929829.902109:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:7925:x1875828770098688:12345-0@lo:502: 00000100:00100000:1.0:1788929829.902515:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:7925:x1875828770098688:12345-0@lo:502: Request processed in 407us (7798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929829.902529:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788929829.902600:0:7925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7925:1875828770098688:0@lo:502: 00000020:01000000:1.0:1788929829.902640:0:7925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788929829.902650:0:7925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788929829.902652:0:7925:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788929829.902658:0:7925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788929829.902660:0:7925:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788929829.902690:0:7925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7925:1875828770098816:0@lo:502: 00000100:00100000:1.0:1788929829.902733:0:7925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929829.902763:0:7925:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5000 going to sleep for 11 seconds 00000100:00100000:2.0:1788929829.902960:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770098816 00000100:00100000:2.0:1788929829.902967:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770098816 00000100:00100000:2.0:1788929829.903003:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788929829.903010:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:7925:x1875828770098816:12345-0@lo:502: 00000100:00100000:2.0:1788929829.903162:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:7925:x1875828770098816:12345-0@lo:502: Request processed in 151us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929829.903169:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788929829.904156:0:7925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7925:1875828770098816:0@lo:502: 00000020:01000000:1.0:1788929829.904194:0:7925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788929829.904202:0:7925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788929829.904204:0:7925:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788929829.904209:0:7925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788929829.904299:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788929829.904315:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788929829.904325:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c845 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929829.904337:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c845 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929829.904349:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788929829.904352:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2e86b99000 from 30 10000000:01000000:1.0:1788929829.904354:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788929829.905620:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929829.905648:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929829.905660:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929829.905683:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770098944:0@lo:101: 00000100:00100000:1.0:1788929829.905745:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929829.905794:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5000 going to sleep for 11 seconds 00000100:00100000:3.0:1788929829.906030:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770098944 00000100:00100000:3.0:1788929829.906045:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770098944 00000100:00100000:3.0:1788929829.906101:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788929829.906110:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770098944:12345-0@lo:101: 00010000:00010000:3.0:1788929829.906123:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929829.906139:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237c853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c84c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.906163:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237c853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c84c expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.906173:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237c853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c84c expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.906183:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152400, rc 0) 00000100:00100000:3.0:1788929829.906274:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770098944:12345-0@lo:101: Request processed in 165us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.906281:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788929829.906328:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770098944:0@lo:101: 00010000:00010000:3.0:1788929829.906341:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c853 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.906349:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c853 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929829.906549:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770099072:0@lo:501: 00000100:00100000:3.0:1788929829.906576:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929829.906592:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788929829.906603:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770099072 00000100:00100000:3.0:1788929829.906607:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770099072 00000100:00100000:3.0:1788929829.906623:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788929829.906629:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770099072:12345-0@lo:501: 00000100:00100000:3.0:1788929829.906894:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770099072:12345-0@lo:501: Request processed in 264us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.906901:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788929829.906932:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770099072:0@lo:501: 00000100:00100000:3.0:1788929829.906956:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770099200:0@lo:503: 00000100:00100000:3.0:1788929829.906990:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929829.907003:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84b1f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929829.907014:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770099200 00000100:00100000:3.0:1788929829.907017:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770099200 00000100:00100000:3.0:1788929829.907465:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788929829.907477:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770099200:12345-0@lo:503: 00000100:00100000:3.0:1788929829.907630:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770099200:12345-0@lo:503: Request processed in 157us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.907638:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788929829.907679:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770099200:0@lo:503: 00000100:00100000:3.0:1788929829.907854:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7926:1875828770099328:0@lo:502: 00000100:00100000:3.0:1788929829.907890:0:7926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929829.907917:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770099328 00000100:00100000:3.0:1788929829.907921:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770099328 00000100:00100000:3.0:1788929829.907940:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788929829.907947:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:7926:x1875828770099328:12345-0@lo:502: 00000100:00100000:2.0:1788929829.909291:0:7926:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84b1f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788929829.911468:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:7926:x1875828770099328:12345-0@lo:502: Request processed in 3510us (3566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.911483:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788929829.925266:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7926:1875828770099328:0@lo:502: 00000100:00100000:3.0:1788929829.925454:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7926:1875828770099456:0@lo:502: 00000100:00100000:3.0:1788929829.925528:0:7926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929829.925567:0:7926:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e906a09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788929829.925877:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770099456 00000100:00100000:2.0:1788929829.925885:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770099456 00000100:00100000:2.0:1788929829.925940:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788929829.925948:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:7926:x1875828770099456:12345-0@lo:502: 00000100:00100000:2.0:1788929829.926210:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:7926:x1875828770099456:12345-0@lo:502: Request processed in 261us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929829.926218:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788929829.926435:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7926:1875828770099456:0@lo:502: 00000040:00080000:3.0:1788929829.926461:0:7926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788929829.927616:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788929829.927643:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788929829.927654:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c853 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.927684:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c853 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788929829.927695:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788929829.927697:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2e86b99000 from 5 10000000:01000000:2.0:1788929829.927700:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788929829.927736:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.927745:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.927755:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929829.927778:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770099584:0@lo:101: 00000100:00100000:2.0:1788929829.927828:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929829.927862:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90a896c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929829.927959:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770099584 00000100:00100000:3.0:1788929829.927966:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770099584 00000100:00100000:3.0:1788929829.928002:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788929829.928009:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770099584:12345-0@lo:101: 00010000:00010000:3.0:1788929829.928021:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929829.928042:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237c861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c85a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.928075:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237c861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c85a expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.928085:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237c861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c85a expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.928092:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152a00, rc 0) 00000100:00100000:3.0:1788929829.928127:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770099584:12345-0@lo:101: Request processed in 118us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.928139:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788929829.928360:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770099584:0@lo:101: 00010000:00010000:2.0:1788929829.928374:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.928395:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929829.928446:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770099712:0@lo:256: 00000100:00100000:2.0:1788929829.928479:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929829.928511:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90a896c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929829.928640:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770099712 00000100:00100000:3.0:1788929829.928645:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770099712 00000100:00100000:3.0:1788929829.928669:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788929829.928676:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770099712:12345-0@lo:256: 20000000:01000000:3.0:1788929829.928689:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788929829.928705:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788929829.928708:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788929829.928779:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770099712:12345-0@lo:256: Request processed in 102us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.928786:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788929829.929114:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770099712:0@lo:256: 10000000:01000000:2.0:1788929829.929160:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788929829.929168:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.929177:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788929829.929185:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788929829.929187:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788929829.929189:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788929829.929211:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.929218:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.929260:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929829.929274:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770099840:0@lo:101: 00000100:00100000:2.0:1788929829.929301:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929829.929319:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e863f0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788929829.929333:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770099840 00000100:00100000:2.0:1788929829.929337:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770099840 00000100:00100000:2.0:1788929829.929361:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788929829.929367:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770099840:12345-0@lo:101: 00010000:00010000:2.0:1788929829.929375:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929829.929407:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237c86f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c868 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.929424:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237c86f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c868 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.929433:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237c86f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c868 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.929440:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ea3c53200, rc 0) 00000100:00100000:2.0:1788929829.929468:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770099840:12345-0@lo:101: Request processed in 101us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929829.929474:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788929829.929503:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770099840:0@lo:101: 00010000:00010000:2.0:1788929829.929514:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c86f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929829.929521:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c86f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929829.929566:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770099968:0@lo:501: 00000100:00100000:2.0:1788929829.929590:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929829.929602:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e863f0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788929829.929613:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770099968 00000100:00100000:2.0:1788929829.929616:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770099968 00000100:00100000:2.0:1788929829.929633:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788929829.929638:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770099968:12345-0@lo:501: 00000100:00100000:2.0:1788929829.929877:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770099968:12345-0@lo:501: Request processed in 237us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929829.929892:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788929829.929921:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770099968:0@lo:501: 00000100:00100000:2.0:1788929829.929947:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770100096:0@lo:503: 00000100:00100000:2.0:1788929829.929984:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929829.929996:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e863f0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788929829.930007:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770100096 00000100:00100000:2.0:1788929829.930010:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770100096 00000100:00100000:2.0:1788929829.930025:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788929829.930031:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770100096:12345-0@lo:503: 00000100:00100000:2.0:1788929829.930339:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770100096:12345-0@lo:503: Request processed in 307us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929829.930346:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788929829.930382:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770100096:0@lo:503: 00000100:00100000:2.0:1788929829.930635:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7927:1875828770100224:0@lo:502: 00000100:00100000:2.0:1788929829.930671:0:7927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929829.930690:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770100224 00000100:00100000:2.0:1788929829.930694:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770100224 00000100:00100000:2.0:1788929829.930711:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788929829.930717:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:7927:x1875828770100224:12345-0@lo:502: 00000100:00100000:2.0:1788929829.930937:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:7927:x1875828770100224:12345-0@lo:502: Request processed in 219us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929829.930943:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788929829.930973:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e863f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788929829.930985:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7927:1875828770100224:0@lo:502: 00000020:01000000:2.0:1788929829.931017:0:7927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788929829.931025:0:7927:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788929829.931032:0:7927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788929829.931034:0:7927:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788929829.931039:0:7927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788929829.931043:0:7927:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:2.0:1788929829.931079:0:7927:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788929829.931082:0:7927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788929829.931104:0:7927:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d2e881e0000) 00000020:00000080:2.0:1788929829.931131:0:7927:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788929829.931138:0:7927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788929829.931204:0:7927:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788929829.931210:0:7927:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788929829.931216:0:7927:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237c87d 00010000:00080000:2.0:1788929829.931269:0:7927:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2e87c55000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:2.0:1788929829.931483:0:7927:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788929829.931782:0:7927:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788929829.931793:0:7927:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788929829.935441:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788929829.935735:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788929829.935787:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788929829.935848:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788929829.939684:0:7928:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788929829.939694:0:7928:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788929829.940605:0:7927:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788929829.940617:0:7927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788929829.940649:0:7927:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788929829.940673:0:7927:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237c884 00000100:00080000:3.0:1788929829.940683:0:7927:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788929829.940696:0:7927:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2e87c55000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1788929829.940732:0:7927:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d85551c00 x1875828770100352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788929829.940765:0:7927:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788929829.940824:0:7927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788929829.940829:0:7927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929829.940831:0:7927:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788929829.940834:0:7927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788929829.940838:0:7927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929829.940839:0:7927:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788929829.940842:0:7927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788929829.940843:0:7927:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788929829.940869:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7927:1875828770100480:0@lo:502: 00000100:00100000:3.0:1788929829.940961:0:7927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929829.941000:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788929829.941328:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770100352:0@lo:8: 00000100:00100000:2.0:1788929829.941366:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929829.941419:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770100480 00000100:00100000:2.0:1788929829.941426:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770100480 00000100:00100000:2.0:1788929829.941463:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788929829.941471:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:7927:x1875828770100480:12345-0@lo:502: 00000100:00100000:2.0:1788929829.941697:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:7927:x1875828770100480:12345-0@lo:502: Request processed in 226us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929829.941711:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788929829.941881:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770100352 00000100:00100000:3.0:1788929829.941887:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770100352 00000100:00100000:3.0:1788929829.941910:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788929829.941915:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875828770100352:12345-0@lo:8: 00010000:00080000:3.0:1788929829.941937:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:3.0:1788929829.941962:0:6685:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237c88b 00002000:00100000:3.0:1788929829.941977:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d2e87c55800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788929829.941981:0:6685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788929829.941986:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788929829.942272:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770100992:0@lo:400: 00000100:00100000:1.0:1788929829.942305:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929829.942329:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788929829.942336:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770100608:0@lo:400: 00000100:00100000:1.0:1788929829.942356:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929829.942390:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770100736:0@lo:400: 00000100:00100000:1.0:1788929829.942413:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929829.942436:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788929829.942442:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770100864:0@lo:400: 00000100:00100000:1.0:1788929829.942462:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929829.942488:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770100992 00000100:00100000:1.0:1788929829.942492:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770100992 00000100:00100000:1.0:1788929829.942515:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770100608 00000100:00100000:1.0:1788929829.942517:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770100608 00000100:00100000:1.0:1788929829.942528:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770100736 00000100:00100000:1.0:1788929829.942530:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770100736 00000100:00100000:1.0:1788929829.942554:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788929829.942560:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770100992:12345-0@lo:400: 00000100:00100000:1.0:1788929829.942600:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770100992:12345-0@lo:400: Request processed in 40us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929829.942606:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788929829.942620:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788929829.942625:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770100608:12345-0@lo:400: 00000100:00100000:1.0:1788929829.942650:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770100608:12345-0@lo:400: Request processed in 25us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929829.942656:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788929829.942666:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788929829.942672:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770100736:12345-0@lo:400: 00000100:00100000:1.0:1788929829.942700:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770100736:12345-0@lo:400: Request processed in 29us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929829.942705:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788929829.942739:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb61cca80 x1875828770100608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00100000:3.0:1788929829.943372:0:6685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788929829.943460:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770100608:0@lo:400: 00010000:00080000:1.0:1788929829.943478:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb61cce00 x1875828770100992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929829.943486:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770100992:0@lo:400: 00010000:00080000:1.0:1788929829.943516:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb61cc700 x1875828770100736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929829.943524:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770100736:0@lo:400: 00002000:00080000:3.0:1788929829.943870:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788929829.943897:0:6685:0:(import.c:65:import_set_state_nolock()) ffff8d2e87c53000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788929829.944005:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875828770100352:12345-0@lo:8: Request processed in 2088us (2638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.944025:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788929829.944055:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770100864 00000100:00100000:3.0:1788929829.944060:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770100864 00000100:00100000:3.0:1788929829.944109:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788929829.944117:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770100864:12345-0@lo:400: 00000100:00100000:3.0:1788929829.944152:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770100864:12345-0@lo:400: Request processed in 37us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.944158:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788929829.944192:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:7927:1875828770100480:0@lo:502: 00000020:01000000:3.0:1788929829.944247:0:7927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788929829.944259:0:7927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929829.944261:0:7927:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788929829.944266:0:7927:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:1.0:1788929829.946198:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb61ce680 x1875828770100864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929829.946215:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770100864:0@lo:400: 00000020:01000000:3.0:1788929829.951321:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788929829.951364:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788929829.951455:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c86f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.951470:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c86f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788929829.951481:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788929829.951484:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2e8637b380 from 1 10000000:01000000:3.0:1788929829.951488:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788929829.951535:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.951544:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.951556:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929829.951580:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770101120:0@lo:101: 00000100:00100000:3.0:1788929829.951660:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929829.951709:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788929829.951736:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770101120 00000100:00100000:3.0:1788929829.951743:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770101120 00000100:00100000:3.0:1788929829.951874:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788929829.951883:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770101120:12345-0@lo:101: 00010000:00010000:3.0:1788929829.951896:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929829.951918:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c899 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.952139:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c892 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.952152:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c892 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.952161:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153c00, rc 0) 00000100:00100000:3.0:1788929829.952203:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770101120:12345-0@lo:101: Request processed in 321us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929829.952210:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1788929829.952516:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85551c00 x1875828770100352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788929839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929829.952527:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788929829.952536:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788929829.952544:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788929829.952550:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788929829.952553:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e87c55000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788929829.952609:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788929829.952618:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770100352:0@lo:8: 00000100:00100000:3.0:1788929829.952851:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770101120:0@lo:101: 00010000:00010000:3.0:1788929829.952866:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c899 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.952876:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c899 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929829.952939:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770101248:0@lo:501: 00000100:00100000:3.0:1788929829.952971:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929829.952991:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788929829.953005:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770101248 00000100:00100000:3.0:1788929829.953023:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770101248 00000100:00100000:3.0:1788929829.953121:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788929829.953129:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770101248:12345-0@lo:501: 00000100:00100000:3.0:1788929829.954209:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770101248:12345-0@lo:501: Request processed in 1075us (1231us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788929829.954253:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788929829.958841:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770101248:0@lo:501: 10000000:01000000:3.0:1788929829.958892:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788929829.958903:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c899 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929829.958914:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c899 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788929829.965899:0:7928:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788929829.966267:0:7928:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 215122041818ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788929830.042948:0:7929:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788929830.042985:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1875828770101504:0@lo:7: 00000100:00100000:1.0:1788929830.043123:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788929830.043138:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770101376:0@lo:13: 00000100:00100000:1.0:1788929830.043757:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929830.043937:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929830.043957:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d66cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929830.043990:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770101376 00000100:00100000:3.0:1788929830.044001:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770101376 00000100:00100000:3.0:1788929830.044074:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788929830.044086:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875828770101376:12345-0@lo:13: 00002000:00000024:3.0:1788929830.044121:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788929830.044183:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875828770101376:12345-0@lo:13: Request processed in 100us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929830.044190:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788929830.044218:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788929830.044299:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e863fc700 x1875828770101376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929830.044494:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770101376:0@lo:13: 00000100:00100000:1.0:1788929830.044872:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770101504 00000100:00100000:1.0:1788929830.044878:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770101504 00000100:00100000:1.0:1788929830.044918:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788929830.044926:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7929:x1875828770101504:12345-0@lo:7: 00002000:00080000:0.0:1788929830.086682:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788929830.087665:0:6685:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788929830.087875:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7929:x1875828770101504:12345-0@lo:7: Request processed in 42946us (43933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929830.087888:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788929830.087969:0:7929:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e863fce00 x1875828770101504/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788929846 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929830.087984:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1875828770101504:0@lo:7: 00000004:00080000:0.0:1788929830.087999:0:7929:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788929830.088039:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1875828770101632:0@lo:5: 00000100:00100000:0.0:1788929830.088085:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929830.088139:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d867d5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788929830.088160:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770101632 00000100:00100000:0.0:1788929830.088167:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770101632 00000100:00100000:0.0:1788929830.088214:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788929830.088257:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7929:x1875828770101632:12345-0@lo:5: 00002000:00080000:0.0:1788929830.088293:0:6687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788929830.088298:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788929830.091583:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7929:x1875828770101632:12345-0@lo:5: Request processed in 3349us (3486us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788929830.091600:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788929830.091683:0:7929:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbffaa00 x1875828770101632/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788929846 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929830.091704:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1875828770101632:0@lo:5: 00000004:00080000:0.0:1788929830.091731:0:7929:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788929830.091784:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1875828770101760:0@lo:700: 00000100:00100000:0.0:1788929830.091817:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929830.091840:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d867d5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788929830.091861:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770101760 00000100:00100000:0.0:1788929830.091868:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770101760 00000100:00100000:0.0:1788929830.091905:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788929830.091922:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7929:x1875828770101760:12345-0@lo:700: 00000100:00100000:0.0:1788929830.091968:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1875828770101888:0@lo:700: 00000100:00100000:0.0:1788929830.091995:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929830.092012:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d867d5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788929830.092037:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770101888 00000100:00100000:0.0:1788929830.092040:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770101888 00000100:00100000:0.0:1788929830.092077:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788929830.092083:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1875828770101888:12345-0@lo:700: 00000004:00080000:1.0:1788929830.148821:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:3.0:1788929830.246357:0:5846:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788929830.263514:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1875828770101888:12345-0@lo:700: Request processed in 171411us (171497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929830.263530:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788929830.268807:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbff9c00 x1875828770101888/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788929846 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929830.268825:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1875828770101888:0@lo:700: 40000000:02000000:1.0:1788929830.268839:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:1.0:1788929830.302892:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929830.402070:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7929:x1875828770101760:12345-0@lo:700: Request processed in 310130us (310233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929830.402086:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1788929830.402191:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788929830.402213:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1788929830.402268:0:7929:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbff9880 x1875828770101760/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788929846 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929830.402285:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1875828770101760:0@lo:700: 00000004:02000040:0.0:1788929830.510270:0:7929:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788929830.520337:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1875828770102016:0@lo:5: 00000100:00100000:3.0:1788929830.520430:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929830.520488:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98397d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788929830.521207:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770102016 00000100:00100000:0.0:1788929830.521216:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770102016 00000100:00100000:0.0:1788929830.521286:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788929830.521296:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7929:x1875828770102016:12345-0@lo:5: 00002000:00080000:2.0:1788929830.549616:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788929830.549639:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788929830.566937:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7929:x1875828770102016:12345-0@lo:5: Request processed in 45635us (46499us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788929830.566949:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788929830.567331:0:7929:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85550a80 x1875828770102016/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788929846 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929830.567345:0:7929:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788929830.567360:0:7929:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d2d85550a80 x1875828770102016/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788929846 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929830.567372:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7929:1875828770102016:0@lo:5: 00000004:00080000:2.0:1788929830.567400:0:7929:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:3.0:1788929831.021631:0:7987:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788929831.328338:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929831.905726:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770102144:0@lo:13: 00000100:00100000:1.0:1788929831.905794:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929831.905968:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770102144 00000100:00100000:3.0:1788929831.905977:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770102144 00000100:00100000:3.0:1788929831.906058:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788929831.906068:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770102144:12345-0@lo:13: 00002000:00000024:3.0:1788929831.906102:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929831.906146:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770102144:12345-0@lo:13: Request processed in 81us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929831.906153:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788929831.906191:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85550000 x1875828770102144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929831.906211:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770102144:0@lo:13: 00000100:00080000:1.0:1788929831.906414:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788929832.363803:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929833.373949:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929834.397198:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929834.979252:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770102400:0@lo:400: 00000100:00100000:3.0:1788929834.979253:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770102656:0@lo:400: 00000100:00100000:2.0:1788929834.979336:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770102272:0@lo:400: 00000100:00100000:0.0:1788929834.980013:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929834.980095:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770102912:0@lo:400: 00000100:00100000:0.0:1788929834.980126:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929834.980163:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929834.980171:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770102528:0@lo:400: 00000100:00100000:0.0:1788929834.980194:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929834.980285:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770102400 00000100:00100000:0.0:1788929834.980296:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770102400 00000100:00100000:0.0:1788929834.980353:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770102528 00000100:00100000:0.0:1788929834.980356:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770102528 00000100:00100000:0.0:1788929834.980386:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788929834.980396:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770102400:12345-0@lo:400: 00000100:00100000:0.0:1788929834.980457:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770102400:12345-0@lo:400: Request processed in 63us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929834.980465:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788929834.980484:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788929834.980490:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770102528:12345-0@lo:400: 00000100:00100000:0.0:1788929834.980517:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770102528:12345-0@lo:400: Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929834.980523:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788929834.980542:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770102912 00000100:00100000:0.0:1788929834.980546:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770102912 00000100:00100000:0.0:1788929834.980576:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788929834.980582:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875828770102912:12345-0@lo:400: 00000100:00100000:0.0:1788929834.980614:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875828770102912:12345-0@lo:400: Request processed in 32us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929834.980620:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788929834.980646:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788929834.980652:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788929834.980691:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbff9f80 x1875828770102528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929834.980826:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770102528:0@lo:400: 00010000:00080000:0.0:1788929834.980845:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbffbb80 x1875828770102400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929834.980876:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770102400:0@lo:400: 00010000:00080000:0.0:1788929834.980893:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbff9c00 x1875828770102912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929834.980903:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770102912:0@lo:400: 00000100:00100000:3.0:1788929834.989354:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929834.989692:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770102656 00000100:00100000:1.0:1788929834.989706:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770102656 00000100:00100000:1.0:1788929834.989787:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788929834.989798:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770102656:12345-0@lo:400: 00000100:00100000:1.0:1788929834.989895:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770102656:12345-0@lo:400: Request processed in 99us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929834.989903:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788929834.989931:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788929834.989985:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbff9180 x1875828770102656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929834.990000:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770102656:0@lo:400: 00000100:00100000:2.0:1788929834.995340:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929834.995408:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770102784:0@lo:400: 00000100:00100000:2.0:1788929834.995458:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929834.995516:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770102272 00000100:00100000:2.0:1788929834.995527:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770102272 00000100:00100000:2.0:1788929834.995595:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788929834.995605:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770102272:12345-0@lo:400: 00000100:00100000:2.0:1788929834.995663:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770102272:12345-0@lo:400: Request processed in 59us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929834.995671:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788929834.995947:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770102272:0@lo:400: 00000100:00100000:0.0:1788929834.996057:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770102784 00000100:00100000:0.0:1788929834.996062:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770102784 00000100:00100000:0.0:1788929834.996185:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788929834.996193:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770102784:12345-0@lo:400: 00000100:00100000:0.0:1788929834.996256:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770102784:12345-0@lo:400: Request processed in 65us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929834.996263:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788929834.996303:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbffaa00 x1875828770102784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788929850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929834.996316:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770102784:0@lo:400: 00000100:00080000:2.0:1788929834.997458:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788929835.419525:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929835.488608:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770103040:0@lo:13: 00000100:00100000:3.0:1788929835.488706:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929835.488796:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770103040 00000100:00100000:3.0:1788929835.488805:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770103040 00000100:00100000:3.0:1788929835.488864:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788929835.488877:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875828770103040:12345-0@lo:13: 00002000:00000024:3.0:1788929835.488923:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929835.488992:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875828770103040:12345-0@lo:13: Request processed in 117us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929835.489016:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788929835.489386:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85551880 x1875828770103040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929835.489410:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770103040:0@lo:13: 00000001:00080000:2.0:1788929835.651728:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788929836.447978:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929837.020999:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770103168:0@lo:13: 00000100:00100000:1.0:1788929837.021128:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929837.021264:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770103168 00000100:00100000:2.0:1788929837.021274:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770103168 00000100:00100000:2.0:1788929837.021337:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788929837.021348:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770103168:12345-0@lo:13: 00002000:00000024:2.0:1788929837.021382:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929837.021435:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770103168:12345-0@lo:13: Request processed in 88us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929837.021442:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788929837.021661:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788929837.021689:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e863ff480 x1875828770103168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929837.021708:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770103168:0@lo:13: 00010000:00010000:2.0:1788929837.475837:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929837.874512:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929837.874880:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747010176 00000100:00100000:3.0:1788929837.874890:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747010176 00000100:00100000:3.0:1788929837.874958:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 112 00000100:00100000:3.0:1788929837.874966:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875828747010176:12345-192.168.204.40@tcp:250: 00010000:00080000:3.0:1788929837.874995:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 32bd5a92-c2e2-4642-929e-29df1e036b64@192.168.204.40@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:3.0:1788929837.875034:0:5834:0:(genops.c:1384:class_connect()) connect: client 32bd5a92-c2e2-4642-929e-29df1e036b64, cookie 0xce4472dd2237c8a0 00000100:00080000:3.0:1788929837.875197:0:5834:0:(import.c:65:import_set_state_nolock()) ffff8d2e87c50800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788929837.875299:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+5:2358:x1875828747010176:12345-192.168.204.40@tcp:250: Request processed in 332us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929837.875307:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 112 00000100:00100000:1.0:1788929837.881424:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929837.881516:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747010304 00000100:00100000:2.0:1788929837.881526:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747010304 00000100:00100000:2.0:1788929837.881579:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 113 00000100:00100000:2.0:1788929837.881589:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+5:5587:x1875828747010304:12345-192.168.204.40@tcp:101: 00010000:00010000:2.0:1788929837.881606:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929837.881626:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5340e00/0xce4472dd2237c8a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca71640210085 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929837.881655:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5340e00/0xce4472dd2237c8a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210085 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929837.881667:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5340e00/0xce4472dd2237c8a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210085 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929837.881676:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340e00, rc 0) 00000100:00100000:2.0:1788929837.881739:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+6:5587:x1875828747010304:12345-192.168.204.40@tcp:101: Request processed in 151us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929837.881746:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 113 00000100:00100000:1.0:1788929837.891566:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929837.892297:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747010432 00000100:00100000:0.0:1788929837.892309:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747010432 00000100:00100000:0.0:1788929837.892370:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 114 00000100:00100000:0.0:1788929837.892380:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+6:5587:x1875828747010432:12345-192.168.204.40@tcp:501: 00000100:00100000:0.0:1788929837.892627:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+6:5587:x1875828747010432:12345-192.168.204.40@tcp:501: Request processed in 248us (1070us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788929837.892636:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 114 00000100:00100000:2.0:1788929837.901091:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929837.901394:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747010560 00000100:00100000:3.0:1788929837.901406:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747010560 00000100:00100000:3.0:1788929837.901469:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 115 00000100:00100000:3.0:1788929837.901480:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+6:5587:x1875828747010560:12345-192.168.204.40@tcp:101: 00010000:00010000:3.0:1788929837.901496:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929837.901519:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca7164021008c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929837.901550:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021008c expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929837.901562:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021008c expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929837.901588:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596600, rc 0) 00000100:00100000:3.0:1788929837.901654:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+7:5587:x1875828747010560:12345-192.168.204.40@tcp:101: Request processed in 175us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929837.901661:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 115 00000100:00100000:3.0:1788929837.920545:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929837.922282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747010688 00000100:00100000:2.0:1788929837.922296:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747010688 00000100:00100000:2.0:1788929837.922377:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 116 00000100:00100000:2.0:1788929837.922390:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+7:5587:x1875828747010688:12345-192.168.204.40@tcp:501: 00000100:00100000:2.0:1788929837.922762:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+8:5587:x1875828747010688:12345-192.168.204.40@tcp:501: Request processed in 373us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929837.922770:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 116 00000100:00100000:1.0:1788929837.945803:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929837.949099:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747010816 00000100:00100000:0.0:1788929837.949113:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747010816 00000100:00100000:0.0:1788929837.949174:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 117 00000100:00100000:0.0:1788929837.949184:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+8:5587:x1875828747010816:12345-192.168.204.40@tcp:503: 00000100:00100000:0.0:1788929837.949453:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+8:5587:x1875828747010816:12345-192.168.204.40@tcp:503: Request processed in 269us (3659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929837.949460:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 117 00000100:00100000:1.0:1788929837.958682:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929837.959025:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747010944 00000100:00100000:3.0:1788929837.959037:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747010944 00000100:00100000:3.0:1788929837.959098:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 118 00000100:00100000:3.0:1788929837.959108:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+8:5606:x1875828747010944:12345-192.168.204.40@tcp:502: 00000100:00100000:3.0:1788929837.960428:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+8:5606:x1875828747010944:12345-192.168.204.40@tcp:502: Request processed in 1313us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929837.960439:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 118 00000100:00100000:3.0:1788929837.998071:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929837.998115:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747011072 00000100:00100000:3.0:1788929837.998476:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747011072 00000100:00100000:3.0:1788929837.998534:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 119 00000100:00100000:3.0:1788929837.998544:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+8:5606:x1875828747011072:12345-192.168.204.40@tcp:502: 00000100:00100000:3.0:1788929838.003239:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+8:5606:x1875828747011072:12345-192.168.204.40@tcp:502: Request processed in 4281us (4762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929838.003257:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 119 00000100:00100000:2.0:1788929838.023965:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929838.024154:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747011200 00000100:00100000:3.0:1788929838.024164:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747011200 00000100:00100000:3.0:1788929838.024220:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 120 00000100:00100000:3.0:1788929838.024254:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+8:5587:x1875828747011200:12345-192.168.204.40@tcp:101: 00010000:00010000:3.0:1788929838.024288:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929838.024306:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596e00/0xce4472dd2237c8b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca716402100b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929838.024349:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596e00/0xce4472dd2237c8b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100b6 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929838.024369:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596e00/0xce4472dd2237c8b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100b6 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929838.024379:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596e00, rc 0) 00000100:00100000:3.0:1788929838.024440:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+9:5587:x1875828747011200:12345-192.168.204.40@tcp:101: Request processed in 188us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929838.024447:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 120 00000100:00100000:3.0:1788929838.028211:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929838.028295:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747011328 00000100:00100000:3.0:1788929838.028306:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747011328 00000100:00100000:3.0:1788929838.028530:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 121 00000100:00100000:3.0:1788929838.028541:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+9:5587:x1875828747011328:12345-192.168.204.40@tcp:256: 20000000:01000000:3.0:1788929838.028565:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788929838.028588:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788929838.028592:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788929838.028595:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788929838.028597:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788929838.046858:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+9:5587:x1875828747011328:12345-192.168.204.40@tcp:256: Request processed in 18307us (18646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929838.046873:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 121 00000100:00100000:3.0:1788929838.055618:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929838.055674:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747011456 00000100:00100000:3.0:1788929838.055685:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747011456 00000100:00100000:3.0:1788929838.055746:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 122 00000100:00100000:3.0:1788929838.055758:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+9:5587:x1875828747011456:12345-192.168.204.40@tcp:101: 00010000:00010000:3.0:1788929838.055776:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929838.055794:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596a00/0xce4472dd2237c8bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca716402100bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929838.055824:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596a00/0xce4472dd2237c8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100bd expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929838.055836:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596a00/0xce4472dd2237c8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100bd expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929838.055846:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596a00, rc 0) 00000100:00100000:3.0:1788929838.056190:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5587:x1875828747011456:12345-192.168.204.40@tcp:101: Request processed in 432us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929838.056198:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 122 00000100:00100000:2.0:1788929838.072216:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929838.072376:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747011584 00000100:00100000:3.0:1788929838.072387:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747011584 00000100:00100000:3.0:1788929838.072443:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 123 00000100:00100000:3.0:1788929838.072453:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5587:x1875828747011584:12345-192.168.204.40@tcp:501: 00000100:00100000:3.0:1788929838.073367:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5587:x1875828747011584:12345-192.168.204.40@tcp:501: Request processed in 912us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929838.073375:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 123 00000100:00100000:2.0:1788929838.075692:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929838.077825:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747011712 00000100:00100000:3.0:1788929838.077838:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747011712 00000100:00100000:3.0:1788929838.077922:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 124 00000100:00100000:3.0:1788929838.077948:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5587:x1875828747011712:12345-192.168.204.40@tcp:503: 00000100:00100000:3.0:1788929838.078588:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5587:x1875828747011712:12345-192.168.204.40@tcp:503: Request processed in 642us (2903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929838.078597:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 124 00000100:00100000:1.0:1788929838.086481:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929838.086797:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747011840 00000100:00100000:2.0:1788929838.086808:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747011840 00000100:00100000:2.0:1788929838.086866:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 125 00000100:00100000:2.0:1788929838.086877:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5612:x1875828747011840:12345-192.168.204.40@tcp:502: 00000100:00100000:2.0:1788929838.087408:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5612:x1875828747011840:12345-192.168.204.40@tcp:502: Request processed in 531us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929838.087417:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 125 00000100:00100000:1.0:1788929838.100946:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929838.101131:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747011968 00000100:00100000:3.0:1788929838.101142:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747011968 00000100:00100000:3.0:1788929838.101195:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 126 00000100:00100000:3.0:1788929838.101205:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5612:x1875828747011968:12345-192.168.204.40@tcp:502: 00000100:00100000:3.0:1788929838.101467:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5612:x1875828747011968:12345-192.168.204.40@tcp:502: Request processed in 262us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929838.101475:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 126 00000100:00100000:2.0:1788929838.105364:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929838.105500:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747012096 00000100:00100000:0.0:1788929838.105511:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747012096 00000100:00100000:0.0:1788929838.105560:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:0.0:1788929838.105568:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1875828747012096:12345-192.168.204.40@tcp:38: 00010000:00080000:0.0:1788929838.105598:0:5839:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:0.0:1788929838.105642:0:5839:0:(genops.c:1384:class_connect()) connect: client 668b9f78-1e26-4a12-8f20-ad475b3553ba, cookie 0xce4472dd2237c8c3 00000004:00100000:0.0:1788929838.105671:0:5839:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788929838.105676:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788929838.212334:0:5839:0:(import.c:65:import_set_state_nolock()) ffff8d2e881f2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788929838.212414:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2358:x1875828747012096:12345-192.168.204.40@tcp:38: Request processed in 106844us (107061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929838.212425:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00010000:00010000:3.0:1788929838.491301:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929839.245649:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929839.245701:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929839.245998:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747012224 00000100:00100000:0.0:1788929839.246009:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747012224 00000100:00100000:0.0:1788929839.246090:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747012352 00000100:00100000:0.0:1788929839.246104:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747012352 00000100:00100000:0.0:1788929839.246125:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:0.0:1788929839.246136:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:0:x1875828747012224:12345-192.168.204.40@tcp:41: 00000004:00000024:0.0:1788929839.246184:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:1.0:1788929839.246313:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929839.246323:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:0:x1875828747012224:12345-192.168.204.40@tcp:41: Request processed in 188us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929839.246354:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:0.0:1788929839.246374:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:0.0:1788929839.246381:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:5587:x1875828747012352:12345-192.168.204.40@tcp:41: 00000004:00000024:0.0:1788929839.246392:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788929839.246415:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:5587:x1875828747012352:12345-192.168.204.40@tcp:41: Request processed in 35us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929839.246422:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:0.0:1788929839.253588:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929839.253697:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747012480 00000100:00100000:2.0:1788929839.253707:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747012480 00000100:00100000:2.0:1788929839.253782:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:2.0:1788929839.253793:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:5587:x1875828747012480:12345-192.168.204.40@tcp:40: 00000100:00100000:2.0:1788929839.253904:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:5587:x1875828747012480:12345-192.168.204.40@tcp:40: Request processed in 112us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929839.253912:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:2.0:1788929839.270754:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929839.270811:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929839.270854:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929839.270908:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929839.271009:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747012864 00000100:00100000:3.0:1788929839.271020:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747012864 00000100:00100000:3.0:1788929839.271081:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:3.0:1788929839.271094:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:5587:x1875828747012864:12345-192.168.204.40@tcp:33: 00000100:00100000:1.0:1788929839.272020:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747012608 00000100:00100000:1.0:1788929839.272029:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747012608 00000100:00100000:1.0:1788929839.272061:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747012736 00000100:00100000:1.0:1788929839.272064:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747012736 00000100:00100000:1.0:1788929839.272097:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788929839.272106:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875828747012608:12345-192.168.204.40@tcp:8: 00010000:00080000:1.0:1788929839.272134:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:1.0:1788929839.272164:0:6687:0:(genops.c:1384:class_connect()) connect: client 668b9f78-1e26-4a12-8f20-ad475b3553ba, cookie 0xce4472dd2237c8ca 00002000:00100000:1.0:1788929839.272176:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 668b9f78-1e26-4a12-8f20-ad475b3553ba/ffff8d2d84b5e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788929839.272200:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788929839.272574:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788929839.272607:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d2d84b5d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788929839.272742:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2358:x1875828747012608:12345-192.168.204.40@tcp:8: Request processed in 635us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929839.272750:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788929839.272769:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:1.0:1788929839.272774:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875828747012736:12345-192.168.204.40@tcp:8: 00010000:00080000:1.0:1788929839.272791:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:1.0:1788929839.272808:0:6687:0:(genops.c:1384:class_connect()) connect: client 668b9f78-1e26-4a12-8f20-ad475b3553ba, cookie 0xce4472dd2237c8d1 00002000:00100000:1.0:1788929839.272813:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 668b9f78-1e26-4a12-8f20-ad475b3553ba/ffff8d2d84b5a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788929839.272827:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788929839.272849:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747012992 00000100:00100000:0.0:1788929839.272855:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747012992 00000100:00100000:0.0:1788929839.272901:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 127 00000100:00100000:0.0:1788929839.272908:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2362:x1875828747012992:12345-192.168.204.40@tcp:400: 00000100:00100000:0.0:1788929839.272938:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2362:x1875828747012992:12345-192.168.204.40@tcp:400: Request processed in 31us (2128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929839.272945:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 127 00002000:00080000:1.0:1788929839.273047:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788929839.273063:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d2d84b59000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788929839.273088:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2358:x1875828747012736:12345-192.168.204.40@tcp:8: Request processed in 312us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929839.273094:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000004:00080000:3.0:1788929839.307601:0:5842:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 36433us 00000004:00200000:0.0:1788929839.365662:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788929839.365786:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:5587:x1875828747012864:12345-192.168.204.40@tcp:33: Request processed in 94689us (95038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929839.365803:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00010000:00010000:1.0:1788929839.515491:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929839.619403:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929839.619625:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747013120 00000100:00100000:3.0:1788929839.619637:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747013120 00000100:00100000:3.0:1788929839.619707:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:3.0:1788929839.619718:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:5629:x1875828747013120:12345-192.168.204.40@tcp:101: 00010000:00010000:3.0:1788929839.619739:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929839.620001:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597e00/0xce4472dd2237c8d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402100e7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929839.620068:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237c8df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929839.620094:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237c8df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929839.620109:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237c8df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929839.620146:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788929839.620150:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788929839.620169:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237c8df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929839.620196:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597e00/0xce4472dd2237c8d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100e7 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929839.620216:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237c8df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100e7 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929839.620346:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4900) 00010000:00010000:3.0:1788929839.620350:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788929839.620353:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597600, rc 0) 00000100:00100000:3.0:1788929839.620427:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:5629:x1875828747013120:12345-192.168.204.40@tcp:101: Request processed in 710us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929839.620434:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:3.0:1788929840.094508:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770103680:0@lo:400: 00000100:00100000:3.0:1788929840.094589:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929840.094677:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788929840.094685:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770103296:0@lo:400: 00000100:00100000:3.0:1788929840.094721:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929840.094775:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770103808:0@lo:400: 00000100:00100000:3.0:1788929840.094810:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929840.094846:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770103424:0@lo:400: 00000100:00100000:3.0:1788929840.094885:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929840.094911:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770103936:0@lo:400: 00000100:00100000:3.0:1788929840.094942:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929840.095489:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770103296 00000100:00100000:1.0:1788929840.095498:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770103296 00000100:00100000:1.0:1788929840.095556:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788929840.095565:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770103296:12345-0@lo:400: 00000100:00100000:1.0:1788929840.095626:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770103296:12345-0@lo:400: Request processed in 62us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929840.095633:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788929840.095665:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770103680 00000100:00100000:1.0:1788929840.095668:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770103680 00000100:00100000:1.0:1788929840.095699:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770103936 00000100:00100000:1.0:1788929840.095701:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770103936 00000100:00100000:1.0:1788929840.095720:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788929840.095726:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770103680:12345-0@lo:400: 00000100:00100000:1.0:1788929840.095758:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770103680:12345-0@lo:400: Request processed in 33us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929840.095765:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788929840.095777:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788929840.095783:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770103936:12345-0@lo:400: 00000100:00100000:1.0:1788929840.095822:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770103936:12345-0@lo:400: Request processed in 38us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929840.095827:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788929840.095858:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770103552:0@lo:400: 00000100:00080000:0.0:1788929840.096143:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788929840.096149:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788929840.096174:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770103808 00000100:00100000:0.0:1788929840.096179:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770103808 00000100:00100000:0.0:1788929840.096253:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770103424 00000100:00100000:0.0:1788929840.096257:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770103424 00000100:00100000:0.0:1788929840.096275:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788929840.096291:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770103808:12345-0@lo:400: 00000100:00100000:0.0:1788929840.096332:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770103808:12345-0@lo:400: Request processed in 43us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929840.096339:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788929840.096354:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788929840.096360:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770103424:12345-0@lo:400: 00000100:00100000:0.0:1788929840.096388:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770103424:12345-0@lo:400: Request processed in 28us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929840.096394:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788929840.096409:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929840.096457:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770103296:0@lo:400: 00000100:00100000:0.0:1788929840.096484:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770103808:0@lo:400: 00010000:00080000:0.0:1788929840.096498:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85550380 x1875828770103680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929840.096517:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770103680:0@lo:400: 00000100:00100000:1.0:1788929840.096765:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929840.096808:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770103552 00000100:00100000:1.0:1788929840.096812:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770103552 00000100:00100000:1.0:1788929840.096848:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788929840.096853:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770103552:12345-0@lo:400: 00000100:00100000:1.0:1788929840.096913:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770103552:12345-0@lo:400: Request processed in 44us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929840.096930:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788929840.096961:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929840.096988:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770103552:0@lo:400: 00010000:00080000:3.0:1788929840.097512:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85552300 x1875828770103936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929840.097522:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788929840.097534:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770103936:0@lo:400: 00000100:00100000:3.0:1788929840.097553:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770103424:0@lo:400: 00010000:00010000:2.0:1788929840.540278:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929840.608342:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770104064:0@lo:13: 00000100:00100000:1.0:1788929840.608428:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929840.608762:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770104064 00000100:00100000:2.0:1788929840.608771:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770104064 00000100:00100000:2.0:1788929840.608825:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788929840.608851:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770104064:12345-0@lo:13: 00002000:00000024:2.0:1788929840.609470:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929840.609544:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770104064:12345-0@lo:13: Request processed in 695us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929840.609552:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788929840.609636:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85552d80 x1875828770104064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929840.609659:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770104064:0@lo:13: 00010000:00010000:3.0:1788929841.563775:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929842.143585:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770104192:0@lo:13: 00000100:00100000:0.0:1788929842.143670:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929842.147086:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770104192 00000100:00100000:3.0:1788929842.147105:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770104192 00000100:00100000:3.0:1788929842.147180:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788929842.147191:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770104192:12345-0@lo:13: 00002000:00000024:3.0:1788929842.147255:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929842.147343:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770104192:12345-0@lo:13: Request processed in 154us (3673us total) trans 0 rc 0/0 00000100:00080000:1.0:1788929842.147488:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788929842.147547:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788929842.148118:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e863fc700 x1875828770104192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929842.148145:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770104192:0@lo:13: 00000100:00100000:2.0:1788929842.421558:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929842.421885:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747013248 00000100:00100000:1.0:1788929842.421895:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747013248 00000100:00100000:1.0:1788929842.421978:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788929842.421988:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:5682:x1875828747013248:12345-192.168.204.40@tcp:41: 00000004:00000024:1.0:1788929842.422041:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788929842.422632:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:5682:x1875828747013248:12345-192.168.204.40@tcp:41: Request processed in 644us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929842.422640:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00080000:0.0:1788929842.422711:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929842.433214:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929842.435808:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747013376 00000100:00100000:3.0:1788929842.435822:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747013376 00000100:00100000:3.0:1788929842.435978:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:3.0:1788929842.435989:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:5682:x1875828747013376:12345-192.168.204.40@tcp:13: 00002000:00000024:3.0:1788929842.436016:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929842.436111:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:5682:x1875828747013376:12345-192.168.204.40@tcp:13: Request processed in 123us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929842.436118:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:2.0:1788929842.440624:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929842.440759:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747013504 00000100:00100000:3.0:1788929842.440770:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747013504 00000100:00080000:0.0:1788929842.442918:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788929842.442929:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788929842.445578:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:3.0:1788929842.445599:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:5682:x1875828747013504:12345-192.168.204.40@tcp:13: 00002000:00000024:3.0:1788929842.445642:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929842.445738:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:5682:x1875828747013504:12345-192.168.204.40@tcp:13: Request processed in 146us (5124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929842.445746:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00010000:00010000:1.0:1788929842.598782:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788929843.253283:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 668b9f78-1e26-4a12-8f20-ad475b3553ba 00010000:00010000:2.0:1788929843.611797:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788929844.352067:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 668b9f78-1e26-4a12-8f20-ad475b3553ba 00000001:00100000:0.0:1788929844.353894:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 668b9f78-1e26-4a12-8f20-ad475b3553ba 00010000:00010000:3.0:1788929844.635415:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929844.702951:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929844.703070:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747013632 00000100:00100000:0.0:1788929844.703081:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747013632 00000100:00100000:0.0:1788929844.703141:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 129 00000100:00100000:0.0:1788929844.703152:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2359:x1875828747013632:12345-192.168.204.40@tcp:400: 00000100:00100000:0.0:1788929844.703293:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2359:x1875828747013632:12345-192.168.204.40@tcp:400: Request processed in 143us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929844.703301:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 129 00000100:00100000:2.0:1788929844.703311:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929844.703373:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747013760 00000100:00100000:0.0:1788929844.703378:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747013760 00000100:00100000:0.0:1788929844.703417:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:0.0:1788929844.703424:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747013760:12345-192.168.204.40@tcp:400: 00000100:00100000:2.0:1788929844.703430:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929844.703462:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747013760:12345-192.168.204.40@tcp:400: Request processed in 38us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929844.703469:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00080000:0.0:1788929844.703485:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929844.704192:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747013888 00000100:00100000:1.0:1788929844.704201:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747013888 00000100:00100000:0.0:1788929844.704278:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00080000:2.0:1788929844.704320:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788929844.709913:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747014016 00000100:00100000:1.0:1788929844.709928:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747014016 00000100:00080000:2.0:1788929844.710990:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788929844.715007:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788929844.715036:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2359:x1875828747013888:12345-192.168.204.40@tcp:400: 00000100:00100000:1.0:1788929844.715125:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2359:x1875828747013888:12345-192.168.204.40@tcp:400: Request processed in 106us (11694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929844.715132:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788929844.715153:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:1.0:1788929844.715175:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2360:x1875828747014016:12345-192.168.204.40@tcp:400: 00000100:00100000:1.0:1788929844.715201:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2360:x1875828747014016:12345-192.168.204.40@tcp:400: Request processed in 28us (10925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929844.715208:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:3.0:1788929845.212391:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770104704:0@lo:400: 00000100:00100000:3.0:1788929845.212471:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929845.212530:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788929845.212537:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770104320:0@lo:400: 00000100:00100000:3.0:1788929845.212565:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929845.212588:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770104832:0@lo:400: 00000100:00100000:3.0:1788929845.212612:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929845.212635:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770104448:0@lo:400: 00000100:00100000:3.0:1788929845.212656:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929845.212671:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770104960:0@lo:400: 00000100:00100000:3.0:1788929845.212689:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929845.212703:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788929845.212709:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770104576:0@lo:400: 00000100:00100000:3.0:1788929845.212736:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929845.212767:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770104704 00000100:00100000:3.0:1788929845.212786:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770104704 00000100:00100000:3.0:1788929845.212848:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770104960 00000100:00100000:3.0:1788929845.212852:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770104960 00000100:00100000:3.0:1788929845.212874:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788929845.212882:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770104704:12345-0@lo:400: 00000100:00100000:3.0:1788929845.212931:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770104704:12345-0@lo:400: Request processed in 49us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929845.212938:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788929845.212957:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788929845.212963:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770104960:12345-0@lo:400: 00000100:00100000:3.0:1788929845.212993:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770104960:12345-0@lo:400: Request processed in 30us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929845.212999:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788929845.213016:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770104320 00000100:00100000:3.0:1788929845.213019:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770104320 00000100:00100000:3.0:1788929845.213043:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788929845.213049:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770104320:12345-0@lo:400: 00000100:00100000:3.0:1788929845.213078:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770104320:12345-0@lo:400: Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929845.213084:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788929845.213109:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770104832 00000100:00100000:3.0:1788929845.213112:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770104832 00000100:00100000:3.0:1788929845.213130:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770104448 00000100:00100000:3.0:1788929845.213133:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770104448 00000100:00100000:3.0:1788929845.213141:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770104576 00000100:00100000:3.0:1788929845.213143:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770104576 00000100:00100000:3.0:1788929845.213166:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788929845.213171:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770104832:12345-0@lo:400: 00000100:00100000:3.0:1788929845.213200:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770104832:12345-0@lo:400: Request processed in 29us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929845.213207:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788929845.213217:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788929845.213243:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770104448:12345-0@lo:400: 00000100:00100000:3.0:1788929845.213269:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770104448:12345-0@lo:400: Request processed in 46us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929845.213275:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788929845.213285:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788929845.213290:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770104576:12345-0@lo:400: 00000100:00100000:3.0:1788929845.213314:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770104576:12345-0@lo:400: Request processed in 23us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929845.213319:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788929845.213344:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788929845.213348:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788929845.213350:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788929845.213381:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770104576:0@lo:400: 00000100:00100000:3.0:1788929845.213391:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770104448:0@lo:400: 00010000:00080000:3.0:1788929845.213402:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85551c00 x1875828770104960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929845.213412:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770104960:0@lo:400: 00000100:00100000:3.0:1788929845.213443:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770104320:0@lo:400: 00000100:00100000:3.0:1788929845.213452:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770104832:0@lo:400: 00010000:00080000:3.0:1788929845.213470:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85551f80 x1875828770104704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929845.213478:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770104704:0@lo:400: 00010000:00010000:1.0:1788929845.660661:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929845.723422:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770105088:0@lo:13: 00000100:00100000:0.0:1788929845.723502:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929845.723619:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770105088 00000100:00100000:1.0:1788929845.723629:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770105088 00000100:00100000:1.0:1788929845.723680:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788929845.723688:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770105088:12345-0@lo:13: 00002000:00000024:1.0:1788929845.723722:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929845.731803:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770105088:12345-0@lo:13: Request processed in 8104us (8289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929845.731820:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788929845.732413:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e88019f80 x1875828770105088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929845.732437:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770105088:0@lo:13: 00000001:02000400:0.0:1788929845.757852:0:8293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788929846.684772:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929847.259477:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788929847.259510:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770105216:0@lo:13: 00000100:00100000:1.0:1788929847.259595:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929847.259767:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770105216 00000100:00100000:0.0:1788929847.259776:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770105216 00000100:00100000:0.0:1788929847.259848:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788929847.259859:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770105216:12345-0@lo:13: 00002000:00000024:0.0:1788929847.259903:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929847.259956:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770105216:12345-0@lo:13: Request processed in 99us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929847.259977:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788929847.260076:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788929847.260113:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefde680 x1875828770105216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929847.260132:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770105216:0@lo:13: 00010000:00010000:3.0:1788929847.707352:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929848.736616:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929849.757169:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929849.818732:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929849.818775:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929849.818801:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929849.818828:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929849.818831:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747014272 00000100:00100000:3.0:1788929849.818840:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747014272 00000100:00100000:3.0:1788929849.818919:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 27 00000100:00100000:3.0:1788929849.818931:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747014272:12345-192.168.204.40@tcp:400: 00000100:00100000:3.0:1788929849.819009:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747014272:12345-192.168.204.40@tcp:400: Request processed in 81us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929849.819016:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 27 00000100:00100000:3.0:1788929849.819040:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747014528 00000100:00100000:3.0:1788929849.819044:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747014528 00000100:00100000:3.0:1788929849.819068:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747014400 00000100:00100000:3.0:1788929849.819070:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747014400 00000100:00100000:3.0:1788929849.819092:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00080000:2.0:1788929849.819092:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788929849.819096:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788929849.819099:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747014528:12345-192.168.204.40@tcp:400: 00000100:00080000:2.0:1788929849.819099:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788929849.819126:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747014528:12345-192.168.204.40@tcp:400: Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929849.819132:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:3.0:1788929849.819144:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:3.0:1788929849.819151:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747014400:12345-192.168.204.40@tcp:400: 00000100:00100000:3.0:1788929849.819173:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747014400:12345-192.168.204.40@tcp:400: Request processed in 23us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929849.819178:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:1.0:1788929849.819446:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747014144 00000100:00100000:1.0:1788929849.819451:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747014144 00000100:00100000:1.0:1788929849.819485:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 131 00000100:00100000:1.0:1788929849.819492:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2362:x1875828747014144:12345-192.168.204.40@tcp:400: 00000100:00100000:1.0:1788929849.819528:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2362:x1875828747014144:12345-192.168.204.40@tcp:400: Request processed in 37us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929849.819544:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 131 00000020:00000080:0.0:1788929850.151071:0:8441:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd849383b0 20000000:00000080:0.0:1788929850.151093:0:8441:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2ebcb43000 uarg=0000000000000000 20000000:01000000:0.0:1788929850.152555:0:8441:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788929850.152559:0:8441:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788929850.152562:0:8441:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788929850.152568:0:8441:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788929850.152573:0:8441:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788929850.152587:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788929850.152590:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788929850.153011:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788929850.153014:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788929850.158162:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788929850.158819:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788929850.158890:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788929850.158927:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1788929850.158940:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788929850.158942:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788929850.162070:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788929850.162944:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788929850.163000:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788929850.163054:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788929850.163069:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788929850.163072:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788929850.164412:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788929850.164949:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788929850.165007:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788929850.165040:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788929850.165051:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788929850.165054:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788929850.169374:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788929850.172491:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788929850.172559:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788929850.172596:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1788929850.172614:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788929850.172634:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.172653:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2e80031600/0xce4472dd2237c7e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c7dc expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.172661:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237c80d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c806 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.172667:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c830 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.172674:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c83e expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.172690:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237c853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c84c expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.172706:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237c86f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c868 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.172713:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c892 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.174120:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2eb5340e00/0xce4472dd2237c8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210085 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.174146:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021008c expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.174155:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.174205:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021008c expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.174245:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021008c expref: 9 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929850.174262:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770105344:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929850.174429:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2eb5340e00/0xce4472dd2237c8a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210085 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.174438:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2eb5340e00/0xce4472dd2237c8a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210085 expref: 9 pid: 5833 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929850.174446:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770105472:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929850.174489:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c892 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.174497:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c899 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c892 expref: 18 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929850.174507:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770105600:0@lo:104: 00000100:00100000:1.0:1788929850.174547:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788929850.174590:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237c86f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c868 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.174599:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237c86f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c868 expref: 18 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929850.174608:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770105728:0@lo:104: 00000100:00100000:3.0:1788929850.174771:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770105600 00000100:00100000:3.0:1788929850.174779:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770105600 00000100:00100000:3.0:1788929850.174838:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788929850.174848:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:8441:x1875828770105600:12345-0@lo:104: 00010000:00010000:3.0:1788929850.174861:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c899 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.185765:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788929850.185782:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:8441:x1875828770105600:12345-0@lo:104: Request processed in 10931us (11231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929850.185799:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788929850.185836:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788929850.185847:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c899 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.185859:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153800 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:2.0:1788929850.185879:0:7628:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c899 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.185890:0:7628:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c899 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788929850.185912:0:7628:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c899 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788929850.185918:0:7628:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788929850.185975:0:7628:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c899 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.185982:0:7628:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788929850.186019:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c899 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.186027:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ec2153800/0xce4472dd2237c892 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c899 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.186042:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929850.186056:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929850.186058:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929850.186074:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770105856:0@lo:103: 00000100:00100000:2.0:1788929850.186121:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929850.186200:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770105856 00000100:00100000:2.0:1788929850.186208:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770105856 00010000:00010000:2.0:1788929850.186264:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c899 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c892 expref: 19 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929850.186298:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788929850.186325:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88018700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770105856:12345-0@lo:103: 00010000:00010000:2.0:1788929850.186340:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929850.186346:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c899 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c892 expref: 19 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.186357:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c899 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c892 expref: 19 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.186375:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929850.186410:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88018700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770105856:12345-0@lo:103: Request processed in 88us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929850.186417:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788929850.186466:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770105856:0@lo:103: 00000100:00100000:1.0:1788929850.186632:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788929850.186694:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237c853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c84c expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.186708:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237c853 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c84c expref: 18 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929850.186719:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770105984:0@lo:104: 00010000:00010000:1.0:1788929850.188332:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c83e expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.188347:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c83e expref: 18 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929850.188360:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770106112:0@lo:104: 00010000:00010000:1.0:1788929850.188399:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c830 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.188409:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c837 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c830 expref: 18 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929850.188418:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770106240:0@lo:104: 00010000:00010000:1.0:1788929850.188445:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237c80d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c806 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.188454:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237c80d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c806 expref: 18 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929850.188462:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770106368:0@lo:104: 00010000:00010000:1.0:1788929850.188489:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2e80031600/0xce4472dd2237c7e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c7dc expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.188499:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2e80031600/0xce4472dd2237c7e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c7dc expref: 18 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929850.188508:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770106496:0@lo:104: 00000100:00100000:1.0:1788929850.188619:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e88011180 going to sleep for 11 seconds 00000100:00100000:1.0:1788929850.188652:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770105344:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929850.188672:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770105472:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929850.188695:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237c899 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c892 expref: 18 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929850.188713:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770105600:0@lo:104: 00000100:00100000:0.0:1788929850.188771:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788929850.188795:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929850.188856:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929850.190842:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929850.190925:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770105728 00000100:00100000:3.0:1788929850.190936:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770105728 00000100:00100000:3.0:1788929850.190980:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770105984 00000100:00100000:3.0:1788929850.190983:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770105984 00000100:00100000:3.0:1788929850.190992:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770106112 00000100:00100000:3.0:1788929850.190994:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770106112 00000100:00100000:3.0:1788929850.191008:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788929850.191017:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb541a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+5:8441:x1875828770105728:12345-0@lo:104: 00010000:00010000:3.0:1788929850.191035:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c86f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929850.191451:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770105728:0@lo:104: 00010000:00010000:3.0:1788929850.191636:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788929850.191643:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb541a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+5:8441:x1875828770105728:12345-0@lo:104: Request processed in 628us (5012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929850.191651:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788929850.191697:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788929850.191704:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+4:8441:x1875828770105984:12345-0@lo:104: 00010000:00010000:3.0:1788929850.191738:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c853 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929850.191830:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929850.191852:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929850.191875:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770105984:0@lo:104: 00000100:00100000:0.0:1788929850.192175:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929850.192194:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929850.192202:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788929850.192209:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1788929850.193918:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788929850.193943:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+4:8441:x1875828770105984:12345-0@lo:104: Request processed in 2229us (5137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929850.193954:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788929850.193972:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770106240 00000100:00100000:1.0:1788929850.193982:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770106240 00000100:00100000:3.0:1788929850.193986:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770106368 00000100:00100000:3.0:1788929850.193994:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770106368 00000100:00100000:1.0:1788929850.194023:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770106496 00000100:00100000:1.0:1788929850.194028:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770106496 00000100:00100000:3.0:1788929850.194031:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788929850.194043:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+6:8441:x1875828770106112:12345-0@lo:104: 00010000:00010000:3.0:1788929850.194057:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c845 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194113:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788929850.194123:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c86f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.194148:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788929850.194154:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+6:8441:x1875828770106112:12345-0@lo:104: Request processed in 116us (5297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929850.194160:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788929850.194171:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788929850.194176:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+5:8441:x1875828770106240:12345-0@lo:104: 00010000:00010000:3.0:1788929850.194183:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c837 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194200:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ea3c53c00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788929850.194206:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c86f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.194209:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788929850.194217:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+5:8441:x1875828770106240:12345-0@lo:104: Request processed in 42us (3382us total) trans 0 rc 0/0 00010000:00010000:0.0:1788929850.194219:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c86f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929850.194238:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 10000000:00010000:0.0:1788929850.194250:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c86f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929850.194252:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 10000000:01000000:0.0:1788929850.194258:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788929850.194273:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+4:8441:x1875828770106368:12345-0@lo:104: 00010000:00010000:3.0:1788929850.194280:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c80d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194297:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c86f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194305:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788929850.194308:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788929850.194314:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+4:8441:x1875828770106368:12345-0@lo:104: Request processed in 44us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929850.194320:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1788929850.194326:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c86f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929850.194333:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788929850.194338:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53c00/0xce4472dd2237c868 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c86f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929850.194343:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:8441:x1875828770106496:12345-0@lo:104: 00010000:00010000:3.0:1788929850.194356:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c7e3 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194362:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788929850.194367:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c853 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.194378:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788929850.194386:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:8441:x1875828770106496:12345-0@lo:104: Request processed in 45us (2190us total) trans 0 rc 0/0 00010000:00010000:0.0:1788929850.194390:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784000 already unused, calling callback (ffffffffc1d26c20) 00000100:00100000:3.0:1788929850.194395:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 10000000:00010000:0.0:1788929850.194397:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c853 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194406:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c853 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929850.194413:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747014656 10000000:00010000:0.0:1788929850.194413:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c853 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929850.194418:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747014656 10000000:01000000:0.0:1788929850.194423:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788929850.194440:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021008c expref: 10 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194441:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c853 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194457:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788929850.194464:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c853 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194471:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99784000/0xce4472dd2237c84c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c853 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929850.194472:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747014784 00000100:00100000:3.0:1788929850.194477:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747014784 00010000:00010000:0.0:1788929850.194485:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788929850.194490:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c845 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.194493:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2eb5340e00/0xce4472dd2237c8a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210085 expref: 11 pid: 5833 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.194494:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788929850.194501:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c837 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194501:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784c00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788929850.194505:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c845 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.194513:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152200 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:2.0:1788929850.194516:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c837 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.194524:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c837 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929850.194526:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 10000000:00010000:2.0:1788929850.194536:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c837 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929850.194540:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32bd5a92-c2e2-4642-929e-29df1e036b64+11:2361:x1875828747014656:12345-192.168.204.40@tcp:103: 10000000:01000000:2.0:1788929850.194544:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788929850.194559:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929850.194563:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c837 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.194566:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021008c expref: 11 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.194580:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788929850.194594:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021008c expref: 11 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.194596:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c837 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.194611:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152200/0xce4472dd2237c830 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c837 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.194619:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021008c expref: 11 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.194623:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788929850.194628:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c80d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.194635:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ea3c52800 already unused, calling callback (ffffffffc1d26c20) 00010000:00010000:3.0:1788929850.194636:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:2.0:1788929850.194638:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c80d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.194645:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c80d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788929850.194651:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c80d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788929850.194656:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788929850.194670:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c80d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.194676:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788929850.194693:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c80d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929850.194698:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2361:x1875828747014656:12345-192.168.204.40@tcp:103: Request processed in 160us (2868us total) trans 0 rc 0/0 00010000:00010000:2.0:1788929850.194703:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c52800/0xce4472dd2237c806 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c80d expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929850.194708:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770106112:0@lo:104: 00000100:00100000:3.0:1788929850.194709:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:3.0:1788929850.194734:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:3.0:1788929850.194741:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32bd5a92-c2e2-4642-929e-29df1e036b64+9:2361:x1875828747014784:12345-192.168.204.40@tcp:103: 00010000:00010000:3.0:1788929850.194747:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929850.194751:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2eb5340e00/0xce4472dd2237c8a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210085 expref: 9 pid: 5833 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.194759:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2eb5340e00/0xce4472dd2237c8a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210085 expref: 9 pid: 5833 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.194768:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5340e00/0xce4472dd2237c8a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210085 expref: 9 pid: 5833 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.194775:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929850.194789:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32bd5a92-c2e2-4642-929e-29df1e036b64+8:2361:x1875828747014784:12345-192.168.204.40@tcp:103: Request processed in 50us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929850.194800:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00010000:00010000:0.0:1788929850.194801:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c845 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788929850.194810:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c845 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929850.194816:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788929850.194835:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c845 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194841:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788929850.194846:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c845 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194851:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c83e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c845 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194860:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788929850.194863:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c7e3 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194868:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785800 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788929850.194872:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c7e3 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194878:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c7e3 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788929850.194885:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c7e3 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929850.194895:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788929850.194917:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c7e3 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194922:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788929850.194926:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c7e3 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194932:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237c7dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c7e3 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929850.194942:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929850.194944:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929850.194946:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929850.194959:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770106752:0@lo:103: 00000100:00100000:0.0:1788929850.194995:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929850.195022:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770107264:0@lo:103: 00000100:00100000:0.0:1788929850.195038:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929850.195051:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788929850.195056:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770106624:0@lo:103: 00000100:00100000:0.0:1788929850.195071:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929850.195080:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770107136:0@lo:103: 00000100:00100000:0.0:1788929850.195098:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788929850.195475:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929850.195477:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929850.195479:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929850.195493:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770106880:0@lo:103: 00000100:00100000:2.0:1788929850.195520:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929850.195535:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788929850.195540:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770107008:0@lo:103: 00000100:00100000:2.0:1788929850.195557:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929850.195607:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770106240:0@lo:104: 00000100:00100000:1.0:1788929850.195625:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770106368:0@lo:104: 00000100:00100000:1.0:1788929850.195634:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875828770106496:0@lo:104: 00010000:00010000:1.0:1788929850.195668:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929850.197514:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770106752 00000100:00100000:3.0:1788929850.197527:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770106752 00010000:00010000:3.0:1788929850.197562:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237c853 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c84c expref: 18 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929850.198304:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770107264 00000100:00100000:3.0:1788929850.198311:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770107264 00000100:00100000:2.0:1788929850.198319:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770106624 00000100:00100000:2.0:1788929850.198325:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770106624 00010000:00010000:3.0:1788929850.198333:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2e80031600/0xce4472dd2237c7e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c7dc expref: 20 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.198347:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237c86f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c868 expref: 20 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929850.198348:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770107136 00000100:00100000:3.0:1788929850.198354:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770107136 00010000:00010000:3.0:1788929850.198369:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c83e expref: 21 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929850.198370:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770106880 00000100:00100000:2.0:1788929850.198376:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770106880 00000100:00100000:3.0:1788929850.198387:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770107008 00000100:00100000:3.0:1788929850.198391:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770107008 00010000:00010000:2.0:1788929850.198393:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c837 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c830 expref: 22 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.198408:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237c80d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c806 expref: 23 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929850.198416:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788929850.198427:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+23:3311:x1875828770106752:12345-0@lo:103: 00000100:00100000:3.0:1788929850.198431:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788929850.198441:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+23:3311:x1875828770107264:12345-0@lo:103: 00010000:00010000:2.0:1788929850.198446:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929850.198451:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929850.198454:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237c853 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c84c expref: 23 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.198459:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2e80031600/0xce4472dd2237c7e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c7dc expref: 23 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.198474:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237c853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c84c expref: 23 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.198486:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2e80031600/0xce4472dd2237c7e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c7dc expref: 23 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.198519:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237c853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c84c expref: 23 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.198525:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e80031600/0xce4472dd2237c7e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c7dc expref: 23 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.198539:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788929850.198653:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929850.199487:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+21:3311:x1875828770107264:12345-0@lo:103: Request processed in 1044us (4444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929850.199496:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788929850.199502:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+21:3311:x1875828770106752:12345-0@lo:103: Request processed in 1076us (4504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929850.199511:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788929850.199524:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788929850.199534:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3311:x1875828770106624:12345-0@lo:103: 00010000:00010000:3.0:1788929850.199545:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929850.199551:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237c86f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c868 expref: 19 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.199561:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237c86f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c868 expref: 19 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929850.199571:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237c86f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c868 expref: 19 pid: 5833 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929850.199602:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788929850.199611:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3311:x1875828770107136:12345-0@lo:103: 00010000:00010000:2.0:1788929850.199619:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929850.199624:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c83e expref: 19 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.199632:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c83e expref: 19 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.199643:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c83e expref: 19 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.199653:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929850.199693:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:3311:x1875828770107136:12345-0@lo:103: Request processed in 73us (4582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929850.199699:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788929850.199714:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788929850.199720:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:3308:x1875828770106880:12345-0@lo:103: 00010000:00010000:2.0:1788929850.199783:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929850.199788:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c837 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c830 expref: 17 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.199797:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c830 expref: 17 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.199816:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237c837 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c830 expref: 17 pid: 5831 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.199828:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929850.199958:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3308:x1875828770106880:12345-0@lo:103: Request processed in 238us (4437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929850.199965:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788929850.199979:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788929850.199985:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:3308:x1875828770107008:12345-0@lo:103: 00010000:00010000:2.0:1788929850.199992:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929850.199996:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237c80d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c806 expref: 15 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.200004:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237c80d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c806 expref: 15 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.200014:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237c80d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c806 expref: 15 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.200025:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.200034:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.200050:0:7629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.200058:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.200072:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.200079:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.200085:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788929850.200089:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.200097:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.200111:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929850.200121:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929850.200219:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:3308:x1875828770107008:12345-0@lo:103: Request processed in 234us (4660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929850.200244:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1788929850.200884:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929850.200973:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770106880:0@lo:103: 00000100:00100000:1.0:1788929850.200996:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770107008:0@lo:103: 00010000:00010000:1.0:1788929850.201018:0:8441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.201026:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929850.201032:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c8e6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929850.201165:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770107264:0@lo:103: 00000100:00100000:0.0:1788929850.201181:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770107136:0@lo:103: 00000100:00100000:0.0:1788929850.201187:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770106752:0@lo:103: 00010000:00010000:3.0:1788929850.201358:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929850.201401:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:3311:x1875828770106624:12345-0@lo:103: Request processed in 1871us (6328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929850.201408:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788929850.201558:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770106624:0@lo:103: 00000100:00100000:1.0:1788929850.337637:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770107392:0@lo:400: 00000100:00100000:1.0:1788929850.337728:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929850.337781:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770107904:0@lo:400: 00000100:00100000:1.0:1788929850.337806:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929850.337836:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788929850.337841:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770107520:0@lo:400: 00000100:00100000:1.0:1788929850.337862:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929850.337889:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770107648:0@lo:400: 00000100:00100000:1.0:1788929850.337911:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929850.337929:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788929850.337934:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770107776:0@lo:400: 00000100:00100000:1.0:1788929850.337953:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929850.338707:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770107392 00000100:00100000:3.0:1788929850.338718:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770107392 00000100:00100000:3.0:1788929850.338762:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770107520 00000100:00100000:3.0:1788929850.338765:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770107520 00000100:00100000:3.0:1788929850.338818:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770107776 00000100:00100000:3.0:1788929850.338821:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770107776 00000100:00100000:3.0:1788929850.338838:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788929850.338846:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770107392:12345-0@lo:400: 00000100:00100000:3.0:1788929850.338910:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770107392:12345-0@lo:400: Request processed in 64us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929850.338917:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788929850.338931:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788929850.338937:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770107520:12345-0@lo:400: 00000100:00100000:3.0:1788929850.338962:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770107520:12345-0@lo:400: Request processed in 25us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929850.338967:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788929850.338977:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788929850.338983:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770107776:12345-0@lo:400: 00000100:00100000:3.0:1788929850.339013:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770107776:12345-0@lo:400: Request processed in 31us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929850.339019:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788929850.339038:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770107904 00000100:00100000:3.0:1788929850.339042:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770107904 00000100:00100000:3.0:1788929850.339066:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770107648 00000100:00100000:3.0:1788929850.339069:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770107648 00000100:00100000:3.0:1788929850.339090:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788929850.339096:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770107904:12345-0@lo:400: 00000100:00100000:3.0:1788929850.340823:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770107904:12345-0@lo:400: Request processed in 30us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929850.340838:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788929850.340864:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788929850.340878:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770107648:12345-0@lo:400: 00000100:00100000:3.0:1788929850.340954:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770107648:12345-0@lo:400: Request processed in 82us (3041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929850.340960:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788929850.340990:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788929850.340996:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788929850.340998:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788929850.341030:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770107520:0@lo:400: 00000100:00100000:3.0:1788929850.341041:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770107392:0@lo:400: 00010000:00080000:3.0:1788929850.341054:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8870e300 x1875828770107904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929850.341063:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770107904:0@lo:400: 00000100:00100000:3.0:1788929850.341101:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770107776:0@lo:400: 00010000:00080000:3.0:1788929850.341112:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8870ca80 x1875828770107648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929850.341122:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770107648:0@lo:400: 00010000:00010000:0.0:1788929850.779461:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929850.843612:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788929850.843642:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770108032:0@lo:13: 00000100:00100000:3.0:1788929850.843747:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929850.843894:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770108032 00000100:00100000:0.0:1788929850.843903:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770108032 00000100:00100000:0.0:1788929850.843963:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788929850.843973:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770108032:12345-0@lo:13: 00002000:00000024:0.0:1788929850.844011:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929850.844067:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770108032:12345-0@lo:13: Request processed in 96us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929850.844073:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788929850.844293:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8801a680 x1875828770108032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929850.844312:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770108032:0@lo:13: 00000100:00100000:2.0:1788929851.548694:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929851.548854:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747014912 00000100:00100000:3.0:1788929851.548869:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747014912 00000100:00100000:3.0:1788929851.548945:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 132 00000100:00100000:3.0:1788929851.548971:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+8:5602:x1875828747014912:12345-192.168.204.40@tcp:101: 00010000:00010000:3.0:1788929851.548990:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929851.549010:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca716402100ee expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929851.549037:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100ee expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929851.549048:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100ee expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929851.549056:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596600, rc 0) 00000100:00100000:3.0:1788929851.549113:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+9:5602:x1875828747014912:12345-192.168.204.40@tcp:101: Request processed in 145us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929851.549120:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 132 00000100:00100000:2.0:1788929851.552181:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929851.552351:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747015040 00000100:00100000:3.0:1788929851.552366:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747015040 00000100:00100000:3.0:1788929851.552441:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 133 00000100:00100000:3.0:1788929851.552454:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+9:5602:x1875828747015040:12345-192.168.204.40@tcp:501: 00000100:00100000:3.0:1788929851.553350:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+9:5602:x1875828747015040:12345-192.168.204.40@tcp:501: Request processed in 894us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929851.553359:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 133 00000100:00100000:2.0:1788929851.564927:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929851.568135:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747015168 00000100:00100000:0.0:1788929851.568151:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747015168 00000100:00100000:0.0:1788929851.568239:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 134 00000100:00100000:0.0:1788929851.568250:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+9:5602:x1875828747015168:12345-192.168.204.40@tcp:503: 00000100:00100000:0.0:1788929851.568513:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+9:5602:x1875828747015168:12345-192.168.204.40@tcp:503: Request processed in 264us (3596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929851.568521:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 134 00000100:00100000:2.0:1788929851.579807:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929851.580620:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747015296 00000100:00100000:3.0:1788929851.580635:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747015296 00000100:00100000:3.0:1788929851.580724:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 135 00000100:00100000:3.0:1788929851.580737:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+9:6076:x1875828747015296:12345-192.168.204.40@tcp:502: 00000100:00100000:3.0:1788929851.581058:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+9:6076:x1875828747015296:12345-192.168.204.40@tcp:502: Request processed in 322us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929851.581074:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 135 00000100:00100000:2.0:1788929851.584477:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929851.584625:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747015424 00000100:00100000:3.0:1788929851.584636:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747015424 00000100:00100000:3.0:1788929851.584793:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 136 00000100:00100000:3.0:1788929851.584806:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+9:6076:x1875828747015424:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788929851.585355:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+9:6076:x1875828747015424:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 549us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929851.585364:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 136 00000100:00100000:2.0:1788929851.598079:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929851.598523:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747015552 00000100:00100000:0.0:1788929851.598535:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747015552 00000100:00100000:0.0:1788929851.598594:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 137 00000100:00100000:0.0:1788929851.598606:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+9:5602:x1875828747015552:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788929851.598624:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929851.598644:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e80030800/0xce4472dd2237c8f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca716402100f5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.598961:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e80030800/0xce4472dd2237c8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100f5 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.598997:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e80030800/0xce4472dd2237c8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100f5 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.599009:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e80030800, rc 0) 00000100:00100000:0.0:1788929851.599084:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5602:x1875828747015552:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 481us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929851.599092:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 137 00000100:00100000:2.0:1788929851.609554:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929851.609698:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747015680 00000100:00100000:0.0:1788929851.609724:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747015680 00000100:00100000:0.0:1788929851.609840:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 138 00000100:00100000:0.0:1788929851.609851:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5602:x1875828747015680:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788929851.610137:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5602:x1875828747015680:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 288us (592us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788929851.610144:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 138 00010000:00010000:2.0:1788929851.804019:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788929851.805122:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788929851.805128:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2d85d86800 from 39 10000000:01000000:0.0:1788929851.805134:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788929851.805188:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.805201:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.805213:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929851.805268:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770108160:0@lo:101: 00000100:00100000:0.0:1788929851.805356:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929851.805427:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aeb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788929851.805537:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770108160 00000100:00100000:1.0:1788929851.805546:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770108160 00000100:00100000:1.0:1788929851.805605:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788929851.805616:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+12:5837:x1875828770108160:12345-0@lo:101: 00010000:00010000:1.0:1788929851.805630:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929851.805645:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c902 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c8fb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.805682:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c8fb expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.805693:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c8fb expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.805702:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99785200, rc 0) 00000100:00100000:1.0:1788929851.805754:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:5837:x1875828770108160:12345-0@lo:101: Request processed in 139us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929851.805769:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788929851.805892:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770108160:0@lo:101: 00010000:00010000:0.0:1788929851.805907:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.805916:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929851.805970:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770108288:0@lo:501: 00000100:00100000:0.0:1788929851.805996:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929851.806021:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aeb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929851.806072:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770108288 00000100:00100000:3.0:1788929851.806077:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770108288 00000100:00100000:3.0:1788929851.806112:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788929851.806120:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:5837:x1875828770108288:12345-0@lo:501: 00000100:00100000:3.0:1788929851.806406:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:5837:x1875828770108288:12345-0@lo:501: Request processed in 286us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929851.806412:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788929851.806523:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770108288:0@lo:501: 00000100:00100000:0.0:1788929851.806549:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770108416:0@lo:503: 00000100:00100000:0.0:1788929851.806588:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929851.806665:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aeb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929851.819540:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770108416 00000100:00100000:3.0:1788929851.819557:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770108416 00000100:00100000:3.0:1788929851.819636:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788929851.819647:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:5837:x1875828770108416:12345-0@lo:503: 00000100:00100000:3.0:1788929851.819927:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:5837:x1875828770108416:12345-0@lo:503: Request processed in 281us (13338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929851.819935:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788929851.820121:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770108416:0@lo:503: 00000100:00100000:3.0:1788929851.824182:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8458:1875828770108544:0@lo:502: 00000100:00100000:3.0:1788929851.824309:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929851.824364:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e865b73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788929851.824436:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770108544 00000100:00100000:1.0:1788929851.824444:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770108544 00000100:00100000:1.0:1788929851.824498:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788929851.824509:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:8458:x1875828770108544:12345-0@lo:502: 00000100:00100000:1.0:1788929851.824787:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:8458:x1875828770108544:12345-0@lo:502: Request processed in 279us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929851.824795:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788929851.825880:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8458:1875828770108544:0@lo:502: 00000100:00100000:0.0:1788929851.825943:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8458:1875828770108672:0@lo:502: 00000100:00100000:0.0:1788929851.825985:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929851.826022:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788929851.826077:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770108672 00000100:00100000:3.0:1788929851.826083:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770108672 00000100:00100000:3.0:1788929851.826123:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788929851.826132:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:8458:x1875828770108672:12345-0@lo:502: 00000100:00100000:3.0:1788929851.826340:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:8458:x1875828770108672:12345-0@lo:502: Request processed in 209us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929851.826347:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788929851.827667:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8458:1875828770108672:0@lo:502: 00000040:00080000:0.0:1788929851.827710:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788929851.827902:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788929851.827925:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788929851.827936:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929851.827948:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788929851.827959:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788929851.827961:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788929851.827965:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788929851.828000:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929851.828008:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929851.828018:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929851.828038:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770108800:0@lo:101: 00000100:00100000:2.0:1788929851.828089:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929851.828128:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929851.828191:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770108800 00000100:00100000:3.0:1788929851.828198:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770108800 00000100:00100000:3.0:1788929851.828272:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788929851.828282:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+13:5837:x1875828770108800:12345-0@lo:101: 00010000:00010000:3.0:1788929851.828294:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929851.828308:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc597200/0xce4472dd2237c910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c909 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929851.828331:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc597200/0xce4472dd2237c910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c909 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929851.828344:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc597200/0xce4472dd2237c910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c909 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929851.828353:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597200, rc 0) 00000100:00100000:3.0:1788929851.828398:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770108800:12345-0@lo:101: Request processed in 117us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929851.828405:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788929851.828480:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770108800:0@lo:101: 00010000:00010000:2.0:1788929851.828492:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929851.828500:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929851.828560:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770108928:0@lo:501: 00000100:00100000:2.0:1788929851.828585:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929851.828610:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788929851.828688:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770108928 00000100:00100000:1.0:1788929851.828693:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770108928 00000100:00100000:1.0:1788929851.828715:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788929851.828722:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770108928:12345-0@lo:501: 00000100:00100000:1.0:1788929851.828995:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770108928:12345-0@lo:501: Request processed in 272us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929851.829002:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788929851.829286:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770108928:0@lo:501: 00000100:00100000:2.0:1788929851.829316:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770109056:0@lo:503: 00000100:00100000:2.0:1788929851.829355:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929851.829382:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788929851.829433:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770109056 00000100:00100000:1.0:1788929851.829437:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770109056 00000100:00100000:1.0:1788929851.829458:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788929851.829465:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770109056:12345-0@lo:503: 00000100:00100000:1.0:1788929851.829669:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770109056:12345-0@lo:503: Request processed in 203us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929851.829677:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788929851.839571:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770109056:0@lo:503: 00000100:00100000:2.0:1788929851.839999:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8459:1875828770109184:0@lo:502: 00000100:00100000:2.0:1788929851.840085:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929851.840127:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788929851.840247:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770109184 00000100:00100000:1.0:1788929851.840254:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770109184 00000100:00100000:1.0:1788929851.840297:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788929851.840315:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:8459:x1875828770109184:12345-0@lo:502: 00000100:00100000:1.0:1788929851.840538:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:8459:x1875828770109184:12345-0@lo:502: Request processed in 224us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929851.840545:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788929851.840689:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8459:1875828770109184:0@lo:502: 00000020:01000000:2.0:1788929851.840714:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788929851.840724:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788929851.840727:0:8459:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788929851.840732:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788929851.840755:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8459:1875828770109312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929851.840789:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929851.840818:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788929851.840873:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770109312 00000100:00100000:3.0:1788929851.840878:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770109312 00000100:00100000:3.0:1788929851.840914:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788929851.840921:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:8459:x1875828770109312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788929851.841071:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:8459:x1875828770109312:12345-0@lo:502:llog_process_th.0 Request processed in 149us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929851.841078:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788929851.841191:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8459:1875828770109312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788929851.841209:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788929851.841213:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788929851.841215:0:8459:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788929851.841219:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788929851.841430:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788929851.841449:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788929851.841460:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.841478:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929851.841490:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788929851.841492:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2eb5357800 from 39 10000000:01000000:0.0:1788929851.841496:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788929851.841522:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.841531:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.841541:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929851.841555:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770109440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788929851.841583:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929851.841612:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788929851.841711:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770109440 00000100:00100000:2.0:1788929851.841715:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770109440 00000100:00100000:2.0:1788929851.841751:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788929851.841758:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:5837:x1875828770109440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788929851.841768:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929851.841782:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5340c00/0xce4472dd2237c91e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c917 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929851.841805:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5340c00/0xce4472dd2237c91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c917 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929851.841817:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5340c00/0xce4472dd2237c91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c917 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929851.841825:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340c00, rc 0) 00000100:00100000:2.0:1788929851.841900:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770109440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929851.841906:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788929851.849433:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770109440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788929851.849467:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.849483:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929851.849566:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770109568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788929851.849634:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929851.849702:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788929851.849781:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770109568 00000100:00100000:2.0:1788929851.849788:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770109568 00000100:00100000:2.0:1788929851.849837:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788929851.849847:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770109568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788929851.850108:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770109568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929851.850115:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788929851.850950:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770109568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788929851.850995:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770109696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788929851.851042:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929851.851065:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788929851.852373:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770109696 00000100:00100000:1.0:1788929851.852385:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770109696 00000100:00100000:1.0:1788929851.852438:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788929851.852448:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770109696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788929851.852685:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770109696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929851.852693:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788929851.852718:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770109696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788929851.853147:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8460:1875828770109824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929851.853193:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929851.853246:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788929851.853353:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770109824 00000100:00100000:3.0:1788929851.853359:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770109824 00000100:00100000:3.0:1788929851.853393:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788929851.853401:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:8460:x1875828770109824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788929851.853603:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:8460:x1875828770109824:12345-0@lo:502:llog_process_th.0 Request processed in 203us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929851.853611:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788929851.853791:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8460:1875828770109824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929851.853829:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8460:1875828770109952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929851.853860:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929851.853888:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788929851.853904:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770109952 00000100:00100000:0.0:1788929851.853910:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770109952 00000100:00100000:0.0:1788929851.853943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788929851.853950:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:8460:x1875828770109952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788929851.854107:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:8460:x1875828770109952:12345-0@lo:502:llog_process_th.0 Request processed in 157us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929851.854114:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788929851.854196:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8460:1875828770109952:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788929851.854218:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788929851.854463:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788929851.854485:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788929851.854760:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929851.854775:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788929851.854787:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788929851.854789:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788929851.854792:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788929851.854825:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929851.854835:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929851.854858:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929851.854877:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770110080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788929851.854914:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929851.854946:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e865b73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788929851.855001:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770110080 00000100:00100000:1.0:1788929851.855007:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770110080 00000100:00100000:1.0:1788929851.855041:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788929851.855049:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:5837:x1875828770110080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788929851.855059:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929851.855072:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e99785800/0xce4472dd2237c92c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c925 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.855107:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e99785800/0xce4472dd2237c92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c925 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.855120:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e99785800/0xce4472dd2237c92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c925 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.855128:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99785800, rc 0) 00000100:00100000:1.0:1788929851.855173:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770110080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929851.855187:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788929851.855339:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770110080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788929851.855353:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.855361:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929851.855403:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770110208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788929851.855426:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929851.855445:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788929851.855515:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770110208 00000100:00100000:2.0:1788929851.855520:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770110208 00000100:00100000:2.0:1788929851.855539:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788929851.855545:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770110208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788929851.855773:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770110208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929851.855780:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788929851.855882:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770110208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788929851.855905:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770110336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788929851.855934:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929851.855958:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788929851.856004:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770110336 00000100:00100000:3.0:1788929851.856008:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770110336 00000100:00100000:3.0:1788929851.856026:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788929851.856031:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770110336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929851.856172:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770110336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929851.856178:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788929851.856313:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770110336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788929851.856733:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8461:1875828770110464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788929851.856767:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929851.856796:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e88011600 going to sleep for 11 seconds 00000100:00100000:2.0:1788929851.857045:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770110464 00000100:00100000:2.0:1788929851.857050:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770110464 00000100:00100000:2.0:1788929851.857080:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788929851.857087:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:8461:x1875828770110464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929851.857283:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:8461:x1875828770110464:12345-0@lo:502:llog_process_th.0 Request processed in 195us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929851.857290:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788929851.857428:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8461:1875828770110464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788929851.857448:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788929851.857467:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788929851.857470:0:8461:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788929851.857474:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788929851.857502:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8461:1875828770110592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788929851.857532:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929851.857554:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788929851.857642:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770110592 00000100:00100000:1.0:1788929851.857646:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770110592 00000100:00100000:1.0:1788929851.857677:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788929851.857684:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:8461:x1875828770110592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788929851.857831:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:8461:x1875828770110592:12345-0@lo:502:llog_process_th.0 Request processed in 147us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929851.857838:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788929851.857903:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8461:1875828770110592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788929851.857921:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788929851.857926:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788929851.857928:0:8461:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788929851.857931:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1788929851.858179:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788929851.858198:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788929851.858206:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.858217:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929851.858258:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788929851.858261:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2e86b99000 from 39 10000000:01000000:1.0:1788929851.858264:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788929851.858288:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.858297:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.858319:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929851.858332:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770110720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788929851.858356:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929851.858373:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e88011780 going to sleep for 11 seconds 00000100:00100000:0.0:1788929851.858425:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770110720 00000100:00100000:0.0:1788929851.858430:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770110720 00000100:00100000:0.0:1788929851.858449:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788929851.858467:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770110720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788929851.858475:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929851.858488:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e80030c00/0xce4472dd2237c93a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c933 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.858518:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e80030c00/0xce4472dd2237c93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c933 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.858529:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e80030c00/0xce4472dd2237c93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c933 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.858548:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e80030c00, rc 0) 00000100:00100000:0.0:1788929851.858586:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770110720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929851.858592:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788929851.858708:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770110720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788929851.858720:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.858729:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929851.858766:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770110848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788929851.858788:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929851.858811:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e88011780 going to sleep for 11 seconds 00000100:00100000:3.0:1788929851.858906:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770110848 00000100:00100000:3.0:1788929851.858910:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770110848 00000100:00100000:3.0:1788929851.858930:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788929851.858935:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770110848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929851.859168:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770110848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929851.859174:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788929851.859327:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770110848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788929851.859353:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770110976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788929851.859389:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929851.859406:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e88011780 going to sleep for 11 seconds 00000100:00100000:1.0:1788929851.859416:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770110976 00000100:00100000:1.0:1788929851.859419:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770110976 00000100:00100000:1.0:1788929851.859437:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788929851.859442:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770110976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788929851.859661:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770110976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929851.859675:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788929851.859710:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770110976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788929851.859871:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8462:1875828770111104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788929851.859903:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929851.859920:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770111104 00000100:00100000:1.0:1788929851.859924:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770111104 00000100:00100000:1.0:1788929851.859940:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788929851.859944:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:8462:x1875828770111104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788929851.860076:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:8462:x1875828770111104:12345-0@lo:502:llog_process_th.0 Request processed in 131us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929851.860083:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788929851.861647:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e880116c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788929851.861695:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8462:1875828770111104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788929851.861764:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8462:1875828770111232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788929851.861814:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929851.861836:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86352240 going to sleep for 11 seconds 00000100:00100000:2.0:1788929851.862049:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770111232 00000100:00100000:2.0:1788929851.862057:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770111232 00000100:00100000:2.0:1788929851.862110:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788929851.862119:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:8462:x1875828770111232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929851.862357:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:8462:x1875828770111232:12345-0@lo:502:llog_process_th.0 Request processed in 239us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929851.862372:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788929851.863697:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8462:1875828770111232:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788929851.863740:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788929851.864136:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788929851.864159:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788929851.864169:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929851.864181:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788929851.864190:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788929851.864193:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788929851.864195:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788929851.864254:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929851.864263:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929851.864272:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929851.864291:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770111360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788929851.864341:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929851.864377:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788929851.867826:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770111360 00000100:00100000:1.0:1788929851.867843:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770111360 00000100:00100000:1.0:1788929851.867913:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788929851.867923:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770111360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788929851.867941:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929851.867972:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e99784000/0xce4472dd2237c948 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c941 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.868002:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e99784000/0xce4472dd2237c948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c941 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.868014:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e99784000/0xce4472dd2237c948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c941 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.868023:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99784000, rc 0) 00000100:00100000:1.0:1788929851.868118:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770111360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (3777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929851.868125:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788929851.868374:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770111360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929851.868394:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929851.868406:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929851.868524:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770111488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929851.868563:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929851.868601:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788929851.868714:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770111488 00000100:00100000:0.0:1788929851.868719:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770111488 00000100:00100000:0.0:1788929851.868756:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788929851.868765:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770111488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788929851.869032:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770111488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929851.869039:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788929851.869528:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770111488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929851.869566:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770111616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929851.869604:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929851.869622:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788929851.869797:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770111616 00000100:00100000:0.0:1788929851.869803:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770111616 00000100:00100000:0.0:1788929851.869836:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788929851.869843:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770111616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788929851.869988:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770111616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929851.869995:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788929851.870264:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770111616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788929851.870681:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8463:1875828770111744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788929851.870722:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929851.870753:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9acd20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788929851.870790:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770111744 00000100:00100000:1.0:1788929851.870794:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770111744 00000100:00100000:1.0:1788929851.870824:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788929851.870832:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:8463:x1875828770111744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788929851.871002:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:8463:x1875828770111744:12345-0@lo:502:llog_process_th.0 Request processed in 170us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929851.871008:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788929851.871173:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8463:1875828770111744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788929851.871196:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788929851.871205:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929851.871208:0:8463:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788929851.871213:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788929851.871327:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8463:1875828770111872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788929851.871362:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929851.871389:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788929851.871431:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770111872 00000100:00100000:1.0:1788929851.871436:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770111872 00000100:00100000:1.0:1788929851.871478:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788929851.871485:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:8463:x1875828770111872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788929851.871628:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:8463:x1875828770111872:12345-0@lo:502:llog_process_th.0 Request processed in 143us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929851.871634:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788929851.871754:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8463:1875828770111872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788929851.871770:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788929851.871774:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788929851.871779:0:8463:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788929851.871783:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788929851.871952:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788929851.871976:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788929851.871984:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.871995:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929851.872004:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788929851.872007:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2e8637b380 from 1 10000000:01000000:1.0:1788929851.872009:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788929851.872029:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237c94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.872036:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237c94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929851.872044:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237c94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929851.872057:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770112000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788929851.872082:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929851.872164:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770112000 00000100:00100000:0.0:1788929851.872168:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770112000 00000100:00100000:0.0:1788929851.872189:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788929851.872194:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770112000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788929851.872202:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929851.872214:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e80030200/0xce4472dd2237c956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c94f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.872251:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e80030200/0xce4472dd2237c956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c94f expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.872261:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e80030200/0xce4472dd2237c956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c94f expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929851.872269:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e80030200, rc 0) 00000100:00100000:1.0:1788929851.872363:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86352240 going to sleep for 11 seconds 00000100:00100000:0.0:1788929851.886644:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770112000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 14438us (14551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929851.886666:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788929851.886844:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770112000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929851.886869:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237c94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c956 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929851.886883:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237c94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c956 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929851.886969:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770112128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929851.887023:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929851.887064:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244780 going to sleep for 11 seconds 00000100:00100000:0.0:1788929851.887698:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770112128 00000100:00100000:0.0:1788929851.887707:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770112128 00000100:00100000:0.0:1788929851.887750:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788929851.887758:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770112128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788929851.888015:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770112128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (992us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788929851.888023:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788929851.888108:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770112128:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788929851.888142:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788929851.888150:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237c94f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c956 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929851.888160:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237c94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c956 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929852.379770:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770112256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788929852.379857:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929852.379970:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770112256 00000100:00100000:2.0:1788929852.379980:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770112256 00000100:00100000:2.0:1788929852.380049:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788929852.380060:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770112256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788929852.380109:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788929852.380425:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788929852.382611:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770112256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1027us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929852.382629:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788929852.384952:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbff9f80 x1875828770112256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929852.384988:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770112256:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788929852.829786:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788929853.653174:0:8502:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff66730b90 20000000:00000080:0.0:1788929853.653196:0:8502:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2ebef2ec00 uarg=0000000000000000 20000000:01000000:0.0:1788929853.653584:0:8502:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788929853.653590:0:8502:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788929853.653595:0:8502:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788929853.663347:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788929853.663694:0:8502:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788929853.688204:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788929853.688291:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788929853.688348:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788929853.688368:0:8502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788929853.688390:0:8502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.688412:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ec2152c00/0xce4472dd2237c726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c71f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.688420:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2e80031e00/0xce4472dd2237c79d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c796 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.688427:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2e99784200/0xce4472dd2237c7ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c7f8 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.688438:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ebc596a00/0xce4472dd2237c8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100bd expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.688446:0:8502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.688509:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ebc596a00/0xce4472dd2237c8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402100bd expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.688526:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ebc596a00/0xce4472dd2237c8bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402100bd expref: 9 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929853.688555:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875828770112384:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929853.688691:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2e99784200/0xce4472dd2237c7ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c7f8 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.688700:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2e99784200/0xce4472dd2237c7ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c7f8 expref: 18 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929853.688711:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875828770112512:0@lo:104: 00000100:00100000:0.0:1788929853.688750:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788929853.688785:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2e80031e00/0xce4472dd2237c79d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c796 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.688794:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2e80031e00/0xce4472dd2237c79d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c796 expref: 18 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929853.688802:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875828770112640:0@lo:104: 00000100:00100000:1.0:1788929853.688823:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770112512 00000100:00100000:0.0:1788929853.688828:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929853.688843:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770112512 00000100:00100000:0.0:1788929853.688863:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788929853.688875:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770112640 00000100:00100000:0.0:1788929853.688879:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770112640 00000100:00100000:0.0:1788929853.688911:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788929853.688920:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+4:8502:x1875828770112512:12345-0@lo:104: 00010000:00010000:0.0:1788929853.688933:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c7ff expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.688977:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788929853.688983:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+4:8502:x1875828770112512:12345-0@lo:104: Request processed in 64us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929853.688986:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788929853.688999:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+4:8502:x1875828770112640:12345-0@lo:104: 00000100:00100000:0.0:1788929853.688999:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1788929853.689012:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c79d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.689029:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788929853.689036:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c7ff expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.689044:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785a00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788929853.689050:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c7ff expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.689059:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c7ff expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788929853.689066:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c7ff expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929853.689072:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788929853.689100:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c7ff expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.689107:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788929853.689120:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788929853.689128:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:8502:x1875828770112640:12345-0@lo:104: Request processed in 133us (300us total) trans 0 rc 0/0 00010000:00010000:0.0:1788929853.689129:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c7ff expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929853.689140:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788929853.689144:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99785a00/0xce4472dd2237c7f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c7ff expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.689161:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788929853.689165:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c79d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.689181:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152e00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788929853.689185:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c79d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.689192:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c79d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788929853.689198:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c79d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929853.689203:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788929853.689209:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929853.689219:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c79d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.689270:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788929853.689332:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770112896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788929853.689363:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929853.689437:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770112896 00000100:00100000:3.0:1788929853.689441:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770112896 00010000:00010000:3.0:1788929853.689464:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2e80031e00/0xce4472dd2237c79d lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c796 expref: 19 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929853.689484:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788929853.689491:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770112896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788929853.689577:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929853.689583:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2e80031e00/0xce4472dd2237c79d lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c796 expref: 19 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.689598:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2e80031e00/0xce4472dd2237c79d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c796 expref: 19 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.689613:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788929853.689863:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c79d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.689871:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ec2152e00/0xce4472dd2237c796 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c79d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.689883:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929853.689884:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929853.689886:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929853.689898:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770112768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788929853.689925:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929853.689959:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770112768 00000100:00100000:0.0:1788929853.689963:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770112768 00010000:00010000:0.0:1788929853.689978:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2e99784200/0xce4472dd2237c7ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c7f8 expref: 20 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929853.690007:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788929853.690013:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+20:3311:x1875828770112768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788929853.690021:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929853.690026:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2e99784200/0xce4472dd2237c7ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c7f8 expref: 20 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.690034:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2e99784200/0xce4472dd2237c7ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c7f8 expref: 20 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.690044:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929853.690141:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+20:3311:x1875828770112768:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929853.690148:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788929853.690187:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770112768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788929853.690245:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ec2152c00/0xce4472dd2237c726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c71f expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.690256:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ec2152c00/0xce4472dd2237c726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c71f expref: 19 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929853.690265:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875828770113024:0@lo:104: 00000100:00100000:0.0:1788929853.690288:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929853.690312:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770113024 00000100:00100000:0.0:1788929853.690316:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770113024 00000100:00100000:0.0:1788929853.690338:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788929853.690345:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:8502:x1875828770113024:12345-0@lo:104: 00010000:00010000:0.0:1788929853.690354:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237c71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c726 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929853.690402:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788929853.690407:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:8502:x1875828770113024:12345-0@lo:104: Request processed in 63us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929853.690413:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788929853.690440:0:8502:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e915e8600 going to sleep for 11 seconds 00010000:00010000:0.0:1788929853.690455:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e99784200/0xce4472dd2237c7ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c7f8 expref: 19 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929853.691167:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875828770112512:0@lo:104: 00010000:00010000:0.0:1788929853.691187:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e80031e00/0xce4472dd2237c79d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c796 expref: 18 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929853.691195:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875828770112640:0@lo:104: 00000100:00100000:0.0:1788929853.691203:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875828770113024:0@lo:104: 00000100:00100000:3.0:1788929853.691734:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:3308:x1875828770112896:12345-0@lo:103:ldlm_bl.0 Request processed in 2240us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929853.691745:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788929853.692177:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788929853.692186:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237c71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c726 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929853.692196:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785600 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:2.0:1788929853.692200:0:7628:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237c71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c726 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929853.692210:0:7628:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237c71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c726 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788929853.692216:0:7628:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237c71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c726 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788929853.692246:0:7628:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788929853.692299:0:7628:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237c71f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c726 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929853.692307:0:7628:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788929853.692323:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237c71f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c726 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929853.692342:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237c71f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c726 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929853.692344:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770113152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788929853.692401:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929853.692446:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770113152 00000100:00100000:3.0:1788929853.692452:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770113152 00010000:00010000:3.0:1788929853.692491:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ec2152c00/0xce4472dd2237c726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c71f expref: 17 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929853.692515:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788929853.692523:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:3309:x1875828770113152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788929853.692535:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929853.692541:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ec2152c00/0xce4472dd2237c726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c71f expref: 17 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.692551:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ec2152c00/0xce4472dd2237c726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c71f expref: 17 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.692565:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2152c00/0xce4472dd2237c726 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c71f expref: 17 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.692578:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929853.692608:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3309:x1875828770113152:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929853.692639:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788929853.692674:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770113152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788929853.693891:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875828770112384:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929853.693928:0:8502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929853.694056:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770112896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788929853.694951:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929853.694956:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929853.694970:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929853.695774:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929853.696991:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747015808 00000100:00100000:3.0:1788929853.697003:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747015808 00010000:00010000:3.0:1788929853.697043:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ebc596a00/0xce4472dd2237c8bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402100bd expref: 10 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929853.697250:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00100000:3.0:1788929853.697263:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88018a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2361:x1875828747015808:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929853.697279:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929853.697285:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ebc596a00/0xce4472dd2237c8bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402100bd expref: 10 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.697299:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ebc596a00/0xce4472dd2237c8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402100bd expref: 10 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.697317:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc596a00/0xce4472dd2237c8bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402100bd expref: 10 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.697335:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.697343:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.697361:0:7629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.697368:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.697387:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.697394:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.697401:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e80030a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788929853.697405:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.697414:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929853.697680:0:8502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929853.697690:0:8502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.699396:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.699421:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c95d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929853.699453:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929853.700368:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88018a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32bd5a92-c2e2-4642-929e-29df1e036b64+9:2361:x1875828747015808:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 3101us (4594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929853.700381:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 24 00010000:00010000:2.0:1788929853.851676:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929854.875458:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929854.939045:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929854.939088:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929854.939128:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929854.939179:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929854.939213:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747016192 00000100:00100000:3.0:1788929854.939252:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747016192 00000100:00100000:3.0:1788929854.939317:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747016320 00000100:00100000:3.0:1788929854.939321:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747016320 00000100:00100000:3.0:1788929854.939344:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:3.0:1788929854.939356:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2359:x1875828747016192:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929854.939373:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747016064 00000100:00100000:1.0:1788929854.939380:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747016064 00000100:00100000:1.0:1788929854.939425:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 31 00000100:00100000:1.0:1788929854.939434:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2359:x1875828747016064:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929854.939453:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2359:x1875828747016192:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 98us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929854.939473:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2359:x1875828747016064:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 39us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929854.939476:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:1.0:1788929854.939486:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 31 00000100:00100000:3.0:1788929854.939508:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:3.0:1788929854.939518:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2359:x1875828747016320:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929854.939544:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2359:x1875828747016320:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929854.939550:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00080000:3.0:1788929854.939575:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788929854.939581:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788929854.939583:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788929854.940256:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747015936 00000100:00100000:0.0:1788929854.940263:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747015936 00000100:00100000:0.0:1788929854.940310:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 171 00000100:00100000:0.0:1788929854.940318:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+9:2359:x1875828747015936:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788929854.940365:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+9:2359:x1875828747015936:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 47us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929854.940373:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 171 10000000:01000000:1.0:1788929855.005337:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788929855.005346:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2d85d86800 from 4 10000000:01000000:1.0:1788929855.005351:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788929855.005399:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929855.005412:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929855.005424:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929855.005449:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770113280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788929855.005536:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929855.005605:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788929855.005718:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770113280 00000100:00100000:3.0:1788929855.005726:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770113280 00000100:00100000:3.0:1788929855.005782:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788929855.005792:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770113280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929855.005805:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929855.005819:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596800/0xce4472dd2237c96b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c964 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929855.005841:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596800/0xce4472dd2237c96b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c964 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929855.005851:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596800/0xce4472dd2237c96b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c964 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929855.005859:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596800, rc 0) 00000100:00100000:3.0:1788929855.005900:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770113280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929855.005914:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788929855.005992:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770113280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788929855.006006:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c96b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929855.006016:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c96b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929855.006072:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770113408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788929855.006097:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929855.006126:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788929855.006217:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770113408 00000100:00100000:3.0:1788929855.006248:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770113408 00000100:00100000:3.0:1788929855.006270:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788929855.006276:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770113408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929855.006528:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770113408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929855.006535:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788929855.006667:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770113408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788929855.006697:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770113536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788929855.006736:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929855.006766:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788929855.006934:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770113536 00000100:00100000:3.0:1788929855.006940:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770113536 00000100:00100000:3.0:1788929855.006973:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788929855.006980:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770113536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929855.007133:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770113536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929855.007140:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788929855.007178:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770113536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788929855.011304:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8551:1875828770113664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929855.011383:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929855.011420:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788929855.011565:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770113664 00000100:00100000:1.0:1788929855.011574:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770113664 00000100:00100000:1.0:1788929855.011626:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788929855.011635:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:8551:x1875828770113664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788929855.011853:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:8551:x1875828770113664:12345-0@lo:502:llog_process_th.0 Request processed in 219us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929855.011860:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788929855.012011:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8551:1875828770113664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788929855.012038:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788929855.012048:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788929855.012050:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788929855.012058:0:8551:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2d85d86800 00000020:00000080:2.0:1788929855.012060:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788929855.012152:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8551:1875828770113792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929855.012191:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929855.012214:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770113792 00000100:00100000:2.0:1788929855.012218:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770113792 00000100:00100000:2.0:1788929855.012266:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788929855.012273:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:8551:x1875828770113792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929855.012380:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:8551:x1875828770113792:12345-0@lo:502:llog_process_th.0 Request processed in 106us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.012387:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788929855.012418:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788929855.012430:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8551:1875828770113792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788929855.012447:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788929855.012462:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788929855.012464:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788929855.012468:0:8551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788929855.013698:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788929855.013725:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788929855.013736:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c96b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929855.013748:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c96b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788929855.013758:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788929855.013760:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2eb5357800 from 4 10000000:01000000:3.0:1788929855.013771:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788929855.013802:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929855.013811:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929855.013821:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929855.013841:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770113920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788929855.013889:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929855.013921:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244840 going to sleep for 11 seconds 00000100:00100000:2.0:1788929855.014216:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770113920 00000100:00100000:2.0:1788929855.014242:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770113920 00000100:00100000:2.0:1788929855.014282:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788929855.014291:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770113920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788929855.014303:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929855.014315:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5341600/0xce4472dd2237c979 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c972 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.014337:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5341600/0xce4472dd2237c979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c972 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.014348:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5341600/0xce4472dd2237c979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c972 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.014356:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341600, rc 0) 00000100:00100000:2.0:1788929855.014398:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770113920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.014404:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788929855.014618:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770113920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788929855.014635:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c979 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.014644:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c979 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929855.014697:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770114048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788929855.014725:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929855.019258:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d66600 going to sleep for 11 seconds 00000100:00100000:3.0:1788929855.026360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770114048 00000100:00100000:3.0:1788929855.026377:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770114048 00000100:00100000:3.0:1788929855.026447:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788929855.026471:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770114048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929855.026822:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770114048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 353us (12095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929855.026830:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788929855.026894:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770114048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929855.026951:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770114176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929855.026998:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929855.027026:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e892443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929855.027041:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770114176 00000100:00100000:3.0:1788929855.027044:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770114176 00000100:00100000:3.0:1788929855.027064:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788929855.027071:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770114176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929855.027663:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770114176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 590us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929855.027671:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788929855.027713:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770114176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929855.029427:0:8555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8555:1875828770114304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788929855.031296:0:8555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929855.031350:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770114304 00000100:00100000:3.0:1788929855.031358:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770114304 00000100:00100000:3.0:1788929855.031411:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788929855.031420:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:8555:x1875828770114304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788929855.033827:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:8555:x1875828770114304:12345-0@lo:502:llog_process_th.0 Request processed in 2399us (2530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929855.033840:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788929855.033908:0:8555:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788929855.033933:0:8555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8555:1875828770114304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788929855.033969:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788929855.033979:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929855.033982:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788929855.033990:0:8555:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2eb5357800 00000020:00000080:3.0:1788929855.033992:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788929855.036399:0:8555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8555:1875828770114432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788929855.040315:0:8555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929855.040366:0:8555:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788929855.040615:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770114432 00000100:00100000:2.0:1788929855.040624:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770114432 00000100:00100000:2.0:1788929855.040674:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788929855.040683:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:8555:x1875828770114432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929855.041773:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:8555:x1875828770114432:12345-0@lo:502:llog_process_th.0 Request processed in 1086us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.041784:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788929855.042735:0:8555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8555:1875828770114432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788929855.042779:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788929855.042793:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929855.042795:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788929855.042800:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788929855.044572:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788929855.044611:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788929855.044623:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c979 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.044636:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c979 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788929855.044646:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788929855.044649:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2e86b99000 from 4 10000000:01000000:2.0:1788929855.044651:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788929855.044686:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.044695:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.044705:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929855.044731:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88018000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770114560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788929855.044790:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929855.044835:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d66a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788929855.047694:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770114560 00000100:00100000:2.0:1788929855.047710:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770114560 00000100:00100000:2.0:1788929855.047767:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788929855.047777:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770114560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788929855.047793:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929855.047811:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5341000/0xce4472dd2237c987 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c980 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.047837:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5341000/0xce4472dd2237c987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c980 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.047847:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5341000/0xce4472dd2237c987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c980 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.047856:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341000, rc 0) 00000100:00100000:2.0:1788929855.047926:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770114560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (3136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.047932:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788929855.047987:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88018000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770114560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788929855.048004:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c987 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.048012:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c987 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929855.048074:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88018000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770114688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788929855.048107:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929855.048158:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d66a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788929855.048172:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770114688 00000100:00100000:2.0:1788929855.048175:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770114688 00000100:00100000:2.0:1788929855.048196:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788929855.048202:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770114688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788929855.051009:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770114688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2793us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.051025:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788929855.051115:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88018000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770114688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788929855.051178:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88018000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770114816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788929855.051264:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929855.051298:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d66a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788929855.051314:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770114816 00000100:00100000:2.0:1788929855.051320:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770114816 00000100:00100000:2.0:1788929855.051350:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788929855.051357:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770114816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788929855.051693:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770114816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 334us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.051700:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788929855.051745:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88018000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770114816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788929855.056102:0:8557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8557:1875828770114944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788929855.056206:0:8557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929855.056267:0:8557:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e890773c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788929855.056402:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770114944 00000100:00100000:2.0:1788929855.056409:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770114944 00000100:00100000:2.0:1788929855.056466:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788929855.056475:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:8557:x1875828770114944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929855.056701:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:8557:x1875828770114944:12345-0@lo:502:llog_process_th.0 Request processed in 227us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.056715:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788929855.056920:0:8557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8557:1875828770114944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788929855.056950:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788929855.056959:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788929855.056962:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788929855.056970:0:8557:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2e86b99000 00000020:00000080:1.0:1788929855.056973:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788929855.057055:0:8557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8557:1875828770115072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788929855.057087:0:8557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929855.057118:0:8557:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e890773c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788929855.061383:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770115072 00000100:00100000:2.0:1788929855.061403:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770115072 00000100:00100000:2.0:1788929855.062319:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788929855.062335:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:8557:x1875828770115072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929855.063804:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:8557:x1875828770115072:12345-0@lo:502:llog_process_th.0 Request processed in 1470us (6710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.063816:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788929855.064014:0:8557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:8557:1875828770115072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788929855.064048:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788929855.064056:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788929855.064058:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788929855.064063:0:8557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788929855.064630:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788929855.064653:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788929855.064663:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c987 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.064675:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c987 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929855.451865:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770115456:0@lo:400:kworker.0 00000100:00100000:3.0:1788929855.451951:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929855.452115:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770115328:0@lo:400:kworker.0 00000100:00100000:2.0:1788929855.452150:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929855.452206:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788929855.452212:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770115200:0@lo:400:kworker.0 00000100:00100000:2.0:1788929855.452280:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770115328 00000100:00100000:2.0:1788929855.452289:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770115328 00000100:00100000:2.0:1788929855.453163:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788929855.453175:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770115328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929855.453262:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770115328:12345-0@lo:400:kworker.0 Request processed in 89us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.453286:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788929855.453430:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788929855.453442:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770115584:0@lo:400:kworker.0 00000100:00100000:3.0:1788929855.453485:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929855.453527:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770115456 00000100:00100000:3.0:1788929855.453533:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770115456 00000100:00100000:3.0:1788929855.453566:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788929855.453574:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770115456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929855.453621:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770115456:12345-0@lo:400:kworker.0 Request processed in 49us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929855.453628:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788929855.453648:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770115584 00000100:00100000:3.0:1788929855.453652:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770115584 00000100:00100000:3.0:1788929855.453672:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788929855.453679:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770115584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929855.453706:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770115584:12345-0@lo:400:kworker.0 Request processed in 28us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929855.453711:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788929855.453746:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770115584:0@lo:400:kworker.0 00010000:00080000:3.0:1788929855.453759:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85551c00 x1875828770115456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929855.453769:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770115456:0@lo:400:kworker.0 00000100:00100000:3.0:1788929855.453826:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929855.453843:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770115712:0@lo:400:kworker.0 00000100:00100000:3.0:1788929855.453865:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929855.453893:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770115328:0@lo:400:kworker.0 00000100:00100000:3.0:1788929855.453912:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770115712 00000100:00100000:3.0:1788929855.453915:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770115712 00000100:00100000:3.0:1788929855.453941:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788929855.453948:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770115712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929855.454155:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770115200 00000100:00100000:2.0:1788929855.454160:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770115200 00000100:00100000:2.0:1788929855.454176:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788929855.454182:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770115200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929855.454222:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770115200:12345-0@lo:400:kworker.0 Request processed in 39us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.454248:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788929855.454276:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770115200:0@lo:400:kworker.0 00000100:00080000:1.0:1788929855.454472:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788929855.454477:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788929855.454487:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788929855.455332:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770115712:12345-0@lo:400:kworker.0 Request processed in 1382us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929855.455566:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788929855.456004:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85552d80 x1875828770115712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929855.456019:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770115712:0@lo:400:kworker.0 00000100:00100000:1.0:1788929855.578930:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929855.579017:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747016448 00000100:00100000:2.0:1788929855.579037:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747016448 00000100:00100000:2.0:1788929855.579099:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 187 00000100:00100000:2.0:1788929855.579108:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+9:5602:x1875828747016448:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788929855.579127:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929855.579146:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5341800/0xce4472dd2237c98e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca716402100fc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.579176:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5341800/0xce4472dd2237c98e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100fc expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.579188:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5341800/0xce4472dd2237c98e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100fc expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929855.579210:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341800, rc 0) 00000100:00100000:2.0:1788929855.579302:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5602:x1875828747016448:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 195us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.579309:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 187 00000100:00100000:0.0:1788929855.582807:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929855.582886:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747016576 00000100:00100000:2.0:1788929855.582897:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747016576 00000100:00100000:2.0:1788929855.582953:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 188 00000100:00100000:2.0:1788929855.582963:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5602:x1875828747016576:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788929855.583435:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5602:x1875828747016576:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 463us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.583443:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 188 00000100:00100000:2.0:1788929855.592149:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929855.592552:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747016704 00000100:00100000:0.0:1788929855.592573:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747016704 00000100:00100000:0.0:1788929855.592674:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 189 00000100:00100000:0.0:1788929855.592686:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5602:x1875828747016704:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788929855.592928:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:5602:x1875828747016704:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 244us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929855.592936:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 189 00000100:00100000:0.0:1788929855.602383:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929855.602696:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747016832 00000100:00100000:2.0:1788929855.602707:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747016832 00000100:00100000:2.0:1788929855.602766:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 190 00000100:00100000:2.0:1788929855.602775:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:6140:x1875828747016832:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788929855.603042:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:6140:x1875828747016832:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 267us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.603051:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 190 00000100:00100000:3.0:1788929855.621384:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929855.621454:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747016960 00000100:00100000:2.0:1788929855.621464:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747016960 00000100:00100000:2.0:1788929855.621520:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 191 00000100:00100000:2.0:1788929855.621530:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:6140:x1875828747016960:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788929855.621793:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:6140:x1875828747016960:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 264us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929855.621807:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 191 00010000:00010000:0.0:1788929855.899400:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929855.965270:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929855.965292:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770115840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788929855.965358:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929855.965413:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770115840 00000100:00100000:0.0:1788929855.965421:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770115840 00000100:00100000:0.0:1788929855.965463:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788929855.965472:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770115840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788929855.965506:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929855.965545:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770115840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929855.965552:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788929855.965601:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefddc00 x1875828770115840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929855.965619:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770115840:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788929856.923577:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929857.504291:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770115968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788929857.504365:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929857.504403:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770115968 00000100:00100000:0.0:1788929857.504591:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770115968 00000100:00100000:1.0:1788929857.504717:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788929857.504727:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770115968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788929857.504770:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788929857.504775:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788929857.504827:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770115968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929857.504846:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788929857.504936:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8870c700 x1875828770115968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929857.504966:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770115968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788929857.948775:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929858.976126:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929859.995432:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929860.067926:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929860.067974:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929860.068005:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929860.068030:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929860.068064:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747017344 00000100:00100000:1.0:1788929860.068075:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747017344 00000100:00100000:1.0:1788929860.068137:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747017472 00000100:00100000:1.0:1788929860.068141:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747017472 00000100:00100000:1.0:1788929860.068169:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:1.0:1788929860.068179:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747017344:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929860.068266:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747017344:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 87us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929860.068274:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:1.0:1788929860.068292:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00100000:1.0:1788929860.068301:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747017472:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929860.068335:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747017472:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 37us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929860.068355:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00100000:1.0:1788929860.068374:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747017216 00000100:00100000:1.0:1788929860.068378:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747017216 00000100:00100000:1.0:1788929860.068407:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 35 00000100:00100000:1.0:1788929860.068414:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747017216:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929860.068443:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747017216:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 30us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929860.068449:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 35 00000100:00080000:1.0:1788929860.068471:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788929860.068475:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788929860.068477:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788929860.069290:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747017088 00000100:00100000:3.0:1788929860.069299:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747017088 00000100:00100000:3.0:1788929860.069374:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 192 00000100:00100000:3.0:1788929860.069382:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2362:x1875828747017088:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929860.069439:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2362:x1875828747017088:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 57us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929860.069446:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 192 00000001:02000400:2.0:1788929860.221105:0:8800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1788929860.571678:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770116224:0@lo:400:kworker.0 00000100:00100000:1.0:1788929860.571771:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929860.571834:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770116736:0@lo:400:kworker.0 00000100:00100000:1.0:1788929860.571864:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929860.571900:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788929860.571906:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770116352:0@lo:400:kworker.0 00000100:00100000:1.0:1788929860.571930:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929860.571966:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770116736 00000100:00100000:1.0:1788929860.571973:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770116736 00000100:00100000:1.0:1788929860.572041:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788929860.572052:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770116736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929860.572105:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770116736:12345-0@lo:400:kworker.0 Request processed in 54us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929860.572113:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788929860.572150:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770116224 00000100:00100000:1.0:1788929860.572154:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770116224 00000100:00100000:1.0:1788929860.572176:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770116352 00000100:00100000:1.0:1788929860.572179:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770116352 00000100:00100000:1.0:1788929860.572195:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788929860.572201:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770116224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929860.572285:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770116224:12345-0@lo:400:kworker.0 Request processed in 83us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929860.572291:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788929860.572302:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788929860.572308:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770116352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929860.572336:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770116352:12345-0@lo:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929860.572342:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788929860.572359:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788929860.572364:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788929860.572416:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770116352:0@lo:400:kworker.0 00000100:00100000:1.0:1788929860.572429:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770116224:0@lo:400:kworker.0 00010000:00080000:1.0:1788929860.572441:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8870d500 x1875828770116736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929860.572452:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770116736:0@lo:400:kworker.0 00000100:00100000:3.0:1788929860.576006:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770116096:0@lo:400:kworker.0 00000100:00100000:3.0:1788929860.576088:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929860.576146:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770116608:0@lo:400:kworker.0 00000100:00100000:3.0:1788929860.576175:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929860.576203:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788929860.576210:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770116480:0@lo:400:kworker.0 00000100:00100000:3.0:1788929860.576284:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929860.576316:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770116608 00000100:00100000:3.0:1788929860.576325:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770116608 00000100:00100000:3.0:1788929860.576401:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788929860.576409:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770116608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929860.576465:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770116608:12345-0@lo:400:kworker.0 Request processed in 57us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929860.576471:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788929860.576813:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770116096 00000100:00100000:3.0:1788929860.576819:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770116096 00000100:00100000:3.0:1788929860.576852:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788929860.576859:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770116096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929860.576892:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770116096:12345-0@lo:400:kworker.0 Request processed in 33us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929860.576897:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788929860.576924:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770116480 00000100:00100000:3.0:1788929860.576928:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770116480 00000100:00100000:3.0:1788929860.576958:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788929860.576965:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770116480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929860.576995:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770116480:12345-0@lo:400:kworker.0 Request processed in 31us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929860.577001:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788929860.577028:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788929860.577032:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788929860.577064:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8870f800 x1875828770116480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929860.577080:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770116480:0@lo:400:kworker.0 00000100:00100000:3.0:1788929860.577105:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770116096:0@lo:400:kworker.0 00000100:00100000:3.0:1788929860.577115:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770116608:0@lo:400:kworker.0 00010000:00010000:1.0:1788929861.020556:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929861.084868:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770116864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788929861.084956:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929861.085073:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770116864 00000100:00100000:0.0:1788929861.085083:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770116864 00000100:00100000:0.0:1788929861.085151:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788929861.085163:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770116864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788929861.085202:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929861.085281:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770116864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929861.085289:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788929861.085638:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefddc00 x1875828770116864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929861.085662:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770116864:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788929862.044523:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929862.621027:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770116992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788929862.621115:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929862.624047:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770116992 00000100:00100000:1.0:1788929862.624062:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770116992 00000100:00100000:1.0:1788929862.624147:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788929862.624160:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770116992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788929862.624205:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929862.624319:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770116992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929862.624326:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788929862.624385:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbff9f80 x1875828770116992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929862.624410:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770116992:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788929862.626419:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788929863.068215:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929864.097929:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929865.115728:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929865.195800:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929865.195838:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929865.195861:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929865.196066:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747017600 00000100:00100000:3.0:1788929865.196076:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747017600 00000100:00100000:3.0:1788929865.196126:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 194 00000100:00100000:3.0:1788929865.196137:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2359:x1875828747017600:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929865.196204:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2359:x1875828747017600:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 69us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929865.196211:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 194 00000100:00100000:1.0:1788929865.196337:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929865.196457:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747017728 00000100:00100000:1.0:1788929865.196461:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747017728 00000100:00100000:1.0:1788929865.196502:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:1.0:1788929865.196509:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2359:x1875828747017728:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929865.196545:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2359:x1875828747017728:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 36us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929865.196550:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:1.0:1788929865.196570:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747017856 00000100:00100000:1.0:1788929865.196574:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747017856 00000100:00100000:1.0:1788929865.196598:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747017984 00000100:00100000:1.0:1788929865.196612:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747017984 00000100:00100000:1.0:1788929865.196637:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:1.0:1788929865.196644:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2358:x1875828747017856:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:1.0:1788929865.196671:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c8ca 00000100:00080000:1.0:1788929865.196683:0:6685:0:(import.c:65:import_set_state_nolock()) ffff8d2d84b5d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788929865.196718:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1788929865.198614:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788929865.198626:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788929865.198629:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929865.198658:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:0.0:1788929865.198673:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2358:x1875828747017984:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:0.0:1788929865.198706:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c8d1 00000100:00080000:0.0:1788929865.198717:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d2d84b59000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788929865.198756:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788929865.199607:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+2:2358:x1875828747017856:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 2956us (3737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929865.199619:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00010000:00010000:1.0:1788929865.199691:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929865.199697:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929865.202127:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+2:2358:x1875828747017984:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 3450us (5780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929865.202141:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:3.0:1788929865.701625:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770117120:0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.701708:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929865.701755:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770117632:0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.701782:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929865.701806:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788929865.701811:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770117504:0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.701835:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929865.701860:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770117248:0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.701883:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929865.701898:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770117760:0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.701918:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929865.701934:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788929865.701949:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770117376:0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.701970:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929865.702009:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770117120 00000100:00100000:3.0:1788929865.702017:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770117120 00000100:00100000:3.0:1788929865.702064:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788929865.702075:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770117120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.702129:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770117120:12345-0@lo:400:kworker.0 Request processed in 55us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929865.702136:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788929865.702167:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770117632 00000100:00100000:3.0:1788929865.702171:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770117632 00000100:00100000:3.0:1788929865.702201:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770117248 00000100:00100000:3.0:1788929865.702204:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770117248 00000100:00100000:3.0:1788929865.702215:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770117376 00000100:00100000:3.0:1788929865.702217:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770117376 00000100:00100000:3.0:1788929865.702256:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788929865.702262:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770117632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.702294:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770117632:12345-0@lo:400:kworker.0 Request processed in 33us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929865.702299:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788929865.702309:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788929865.702314:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770117248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.702340:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770117248:12345-0@lo:400:kworker.0 Request processed in 26us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929865.702346:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788929865.702356:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788929865.702361:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770117376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.702403:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770117376:12345-0@lo:400:kworker.0 Request processed in 41us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929865.702409:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788929865.702443:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770117376:0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.702452:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770117248:0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.702475:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770117120:0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.702483:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770117632:0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.705488:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770117504 00000100:00100000:3.0:1788929865.705505:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770117504 00000100:00100000:3.0:1788929865.705571:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770117760 00000100:00100000:3.0:1788929865.705575:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770117760 00000100:00100000:3.0:1788929865.705604:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788929865.705618:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770117504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.705725:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770117504:12345-0@lo:400:kworker.0 Request processed in 112us (3887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929865.705732:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788929865.705748:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788929865.705754:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770117760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929865.705787:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770117760:12345-0@lo:400:kworker.0 Request processed in 33us (3867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929865.705792:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788929865.705837:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb5b4b800 x1875828770117760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929865.705853:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770117760:0@lo:400:kworker.0 00010000:00080000:3.0:1788929865.705893:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb5b49c00 x1875828770117504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929865.705902:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770117504:0@lo:400:kworker.0 00000100:00080000:0.0:1788929865.709045:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788929865.709058:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788929865.709075:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788929865.715941:0:9043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing yml_node 00010000:00010000:2.0:1788929866.139445:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929866.210714:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929866.210735:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770117888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788929866.210798:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929866.211079:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770117888 00000100:00100000:1.0:1788929866.211087:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770117888 00000100:00100000:1.0:1788929866.211137:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788929866.211147:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770117888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788929866.211179:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929866.211261:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770117888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929866.211267:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788929866.211446:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefdf800 x1875828770117888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929866.211466:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770117888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788929867.174058:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929867.739503:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770118016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788929867.739586:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929867.739751:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770118016 00000100:00100000:1.0:1788929867.739759:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770118016 00000100:00100000:1.0:1788929867.739846:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788929867.739857:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770118016:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788929867.739968:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788929867.740211:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929867.740297:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770118016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 441us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929867.740321:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788929867.740476:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbffbb80 x1875828770118016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929867.740496:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770118016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788929868.187484:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929869.211598:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788929869.862267:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 668b9f78-1e26-4a12-8f20-ad475b3553ba 00000020:00000080:2.0:1788929869.862280:0:7639:0:(genops.c:885:class_export_put()) final put ffff8d2d84b5a800/668b9f78-1e26-4a12-8f20-ad475b3553ba 00000020:00000080:2.0:1788929869.862347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84b5a800/668b9f78-1e26-4a12-8f20-ad475b3553ba for lustre-OST0001 00000020:00000080:2.0:1788929869.863888:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d84b59000 for lustre-OST0001 00000001:00100000:2.0:1788929869.879118:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 668b9f78-1e26-4a12-8f20-ad475b3553ba 00000020:00000080:2.0:1788929869.879127:0:6716:0:(genops.c:885:class_export_put()) final put ffff8d2d84b5e000/668b9f78-1e26-4a12-8f20-ad475b3553ba 00000020:00000080:1.0:1788929869.879185:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84b5e000/668b9f78-1e26-4a12-8f20-ad475b3553ba for lustre-OST0000 00000020:00000080:1.0:1788929869.879246:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d84b5d000 for lustre-OST0000 00010000:00010000:1.0:1788929870.248432:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929870.305420:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929870.305490:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929870.305520:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747018112 00000100:00100000:1.0:1788929870.305529:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747018112 00000100:00100000:1.0:1788929870.305580:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 196 00000100:00100000:1.0:1788929870.305589:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2359:x1875828747018112:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929870.305651:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2359:x1875828747018112:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 63us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929870.305658:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 196 00000100:00100000:1.0:1788929870.305689:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747018240 00000100:00100000:1.0:1788929870.305693:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747018240 00000100:00100000:1.0:1788929870.305739:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00100000:1.0:1788929870.305746:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2359:x1875828747018240:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929870.305782:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2359:x1875828747018240:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 36us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929870.305789:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00080000:1.0:1788929870.305923:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788929870.360997:0:9238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:3.0:1788929870.812463:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770118144:0@lo:400:kworker.0 00000100:00100000:3.0:1788929870.812536:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929870.812691:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770118144 00000100:00100000:1.0:1788929870.812701:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770118144 00000100:00100000:1.0:1788929870.812753:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788929870.812762:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770118144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929870.818898:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770118528:0@lo:400:kworker.0 00000100:00100000:0.0:1788929870.818987:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929870.819032:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788929870.819038:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770118656:0@lo:400:kworker.0 00000100:00100000:0.0:1788929870.819085:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929870.819115:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770118272:0@lo:400:kworker.0 00000100:00100000:0.0:1788929870.819139:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929870.819163:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770118784:0@lo:400:kworker.0 00000100:00100000:0.0:1788929870.819182:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929870.819201:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929870.819207:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770118400:0@lo:400:kworker.0 00000100:00100000:0.0:1788929870.819255:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929870.819288:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770118656 00000100:00100000:0.0:1788929870.819415:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770118656 00000100:00100000:0.0:1788929870.819470:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770118272 00000100:00100000:0.0:1788929870.819473:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770118272 00000100:00100000:0.0:1788929870.819487:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770118400 00000100:00100000:0.0:1788929870.819490:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770118400 00000100:00100000:0.0:1788929870.819509:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788929870.819517:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770118656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929870.819566:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770118656:12345-0@lo:400:kworker.0 Request processed in 50us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929870.819573:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788929870.819598:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788929870.819604:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770118272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929870.819634:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770118272:12345-0@lo:400:kworker.0 Request processed in 31us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929870.819641:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788929870.819653:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788929870.819658:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770118400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929870.819682:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770118400:12345-0@lo:400:kworker.0 Request processed in 24us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929870.819688:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788929870.819706:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770118528 00000100:00100000:0.0:1788929870.819710:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770118528 00000100:00100000:0.0:1788929870.819733:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770118784 00000100:00100000:0.0:1788929870.819735:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770118784 00000100:00100000:0.0:1788929870.819757:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788929870.819764:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770118528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929870.819793:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770118528:12345-0@lo:400:kworker.0 Request processed in 30us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929870.819799:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788929870.819810:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788929870.819815:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770118784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929870.819838:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770118784:12345-0@lo:400:kworker.0 Request processed in 23us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929870.819844:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788929870.819862:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788929870.819866:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788929870.819869:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929870.819901:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770118656:0@lo:400:kworker.0 00010000:00080000:0.0:1788929870.819914:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefded80 x1875828770118528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929870.819924:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770118528:0@lo:400:kworker.0 00000100:00100000:0.0:1788929870.819952:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770118400:0@lo:400:kworker.0 00000100:00100000:0.0:1788929870.819960:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770118272:0@lo:400:kworker.0 00010000:00080000:0.0:1788929870.819969:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefdf800 x1875828770118784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929870.819978:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770118784:0@lo:400:kworker.0 00000100:00100000:1.0:1788929870.820492:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770118144:12345-0@lo:400:kworker.0 Request processed in 7728us (7953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929870.820502:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788929870.827502:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770118144:0@lo:400:kworker.0 00010000:00010000:1.0:1788929871.263782:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929871.329151:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929871.329180:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770118912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788929871.329295:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929871.329753:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770118912 00000100:00100000:3.0:1788929871.329763:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770118912 00000100:00100000:3.0:1788929871.329830:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788929871.329840:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770118912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788929871.329881:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929871.329941:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770118912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929871.329952:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788929871.330502:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e862c2d80 x1875828770118912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929871.330530:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770118912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788929872.283442:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929872.866914:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770119040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788929872.866989:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929872.867090:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770119040 00000100:00100000:1.0:1788929872.867098:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770119040 00000100:00100000:1.0:1788929872.867152:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788929872.867161:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770119040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788929872.867198:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929872.867270:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770119040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929872.867277:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788929872.867298:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788929872.867330:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8870d880 x1875828770119040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929872.867350:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770119040:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788929873.026873:0:9335:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:1.0:1788929873.307497:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929874.331476:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929875.355354:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929875.417917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929875.417968:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929875.417999:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747018368 00000100:00100000:3.0:1788929875.418018:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747018368 00000100:00100000:3.0:1788929875.418069:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 198 00000100:00100000:3.0:1788929875.418091:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2361:x1875828747018368:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929875.418157:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2361:x1875828747018368:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 69us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929875.418164:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 198 00000100:00100000:0.0:1788929875.418447:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747018496 00000100:00100000:0.0:1788929875.418452:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747018496 00000100:00100000:0.0:1788929875.418496:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 47 00000100:00100000:0.0:1788929875.418505:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2361:x1875828747018496:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788929875.418559:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2361:x1875828747018496:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 55us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929875.418565:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 47 00000100:00080000:3.0:1788929875.418895:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788929875.890145:0:9433:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:2.0:1788929875.933110:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770119552:0@lo:400:kworker.0 00000100:00100000:2.0:1788929875.933179:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929875.933266:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788929875.933273:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770119168:0@lo:400:kworker.0 00000100:00100000:0.0:1788929875.933297:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770119552 00000100:00100000:2.0:1788929875.933318:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929875.933343:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770119680:0@lo:400:kworker.0 00000100:00100000:2.0:1788929875.933370:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929875.933473:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770119552 00000100:00100000:0.0:1788929875.933535:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788929875.933546:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770119552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929875.933605:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770119552:12345-0@lo:400:kworker.0 Request processed in 61us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929875.933613:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788929875.934175:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788929875.934330:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770119168 00000100:00100000:3.0:1788929875.934344:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770119168 00000100:00100000:3.0:1788929875.934380:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788929875.934389:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770119168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929875.934435:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770119168:12345-0@lo:400:kworker.0 Request processed in 48us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929875.934442:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788929875.934473:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770119424:0@lo:400:kworker.0 00000100:00100000:3.0:1788929875.934501:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929875.934538:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770119680 00000100:00100000:3.0:1788929875.934542:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770119680 00000100:00100000:3.0:1788929875.934571:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770119424 00000100:00100000:3.0:1788929875.934574:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770119424 00000100:00100000:3.0:1788929875.934589:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788929875.934596:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770119680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929875.934627:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770119680:12345-0@lo:400:kworker.0 Request processed in 32us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929875.934633:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788929875.934658:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788929875.934665:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770119424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929875.934715:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770119424:12345-0@lo:400:kworker.0 Request processed in 51us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929875.934721:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788929875.934736:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788929875.934768:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770119424:0@lo:400:kworker.0 00000100:00100000:2.0:1788929875.935828:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770119296:0@lo:400:kworker.0 00000100:00100000:2.0:1788929875.935878:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929875.935918:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770119808:0@lo:400:kworker.0 00000100:00100000:1.0:1788929875.935963:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770119296 00000100:00100000:2.0:1788929875.935967:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929875.936048:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770119168:0@lo:400:kworker.0 00000100:00100000:2.0:1788929875.936062:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770119680:0@lo:400:kworker.0 00010000:00080000:2.0:1788929875.936075:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8801a680 x1875828770119552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929875.936086:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770119552:0@lo:400:kworker.0 00000100:00100000:3.0:1788929875.936099:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770119808 00000100:00100000:3.0:1788929875.936103:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770119808 00000100:00100000:3.0:1788929875.936154:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788929875.936164:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770119808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929875.936243:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770119808:12345-0@lo:400:kworker.0 Request processed in 81us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929875.936250:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788929875.936534:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770119296 00000100:00100000:1.0:1788929875.936570:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788929875.936578:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770119296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929875.936614:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770119296:12345-0@lo:400:kworker.0 Request processed in 38us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929875.936628:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788929875.938341:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788929875.938389:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770119296:0@lo:400:kworker.0 00010000:00080000:2.0:1788929875.938407:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e88018e00 x1875828770119808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929875.938418:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770119808:0@lo:400:kworker.0 00010000:00010000:1.0:1788929876.387131:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929876.445693:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788929876.445719:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770119936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788929876.445793:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929876.446109:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770119936 00000100:00100000:1.0:1788929876.446118:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770119936 00000100:00100000:1.0:1788929876.446179:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788929876.446201:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770119936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788929876.446255:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929876.447429:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770119936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1239us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929876.447439:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788929876.454126:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e862c2d80 x1875828770119936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929876.454162:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770119936:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788929877.403434:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788929877.617647:0:9482:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 9 00:57:55 EDT 2026 00000100:00100000:2.0:1788929877.979567:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770120064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788929877.979641:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929877.979858:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770120064 00000100:00100000:0.0:1788929877.979866:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770120064 00000100:00100000:0.0:1788929877.979938:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788929877.979948:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770120064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788929877.979984:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929877.980046:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770120064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929877.980053:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788929877.980126:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788929877.980219:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8870d880 x1875828770120064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929877.980258:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770120064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788929878.428642:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929879.451871:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929880.475400:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929880.541702:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929880.541917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929880.542133:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747018624 00000100:00100000:2.0:1788929880.542144:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747018624 00000100:00100000:2.0:1788929880.542207:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 200 00000100:00100000:2.0:1788929880.542220:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2360:x1875828747018624:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929880.542341:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2360:x1875828747018624:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 124us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929880.542347:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 200 00000100:00100000:1.0:1788929880.544496:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747018752 00000100:00100000:1.0:1788929880.544512:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747018752 00000100:00100000:1.0:1788929880.544697:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 51 00000100:00100000:1.0:1788929880.544709:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747018752:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929880.545089:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747018752:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 381us (3397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929880.545098:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 51 00000100:00080000:2.0:1788929880.546351:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929881.062922:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770120192:0@lo:400:kworker.0 00000100:00100000:1.0:1788929881.063150:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929881.063215:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770120192 00000100:00100000:3.0:1788929881.063247:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770120192 00000100:00100000:1.0:1788929881.063294:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770120320:0@lo:400:kworker.0 00000100:00100000:3.0:1788929881.063306:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788929881.063319:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770120192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929881.063328:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929881.063370:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770120320 00000100:00100000:1.0:1788929881.063375:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770120320 00000100:00100000:3.0:1788929881.063381:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770120192:12345-0@lo:400:kworker.0 Request processed in 64us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929881.063392:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788929881.063414:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788929881.063436:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770120320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929881.063487:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770120320:12345-0@lo:400:kworker.0 Request processed in 54us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929881.063494:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788929881.063530:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770120192:0@lo:400:kworker.0 00000100:00100000:3.0:1788929881.063551:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770120320:0@lo:400:kworker.0 00000100:00100000:1.0:1788929881.064716:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770120576:0@lo:400:kworker.0 00000100:00100000:1.0:1788929881.064762:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929881.064815:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770120576 00000100:00100000:1.0:1788929881.064822:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770120576 00000100:00100000:1.0:1788929881.064874:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788929881.064882:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770120576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929881.065070:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929881.065081:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770120448:0@lo:400:kworker.0 00000100:00100000:0.0:1788929881.065127:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788929881.065508:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788929881.065881:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770120832:0@lo:400:kworker.0 00000100:00100000:0.0:1788929881.065920:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929881.066081:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770120704:0@lo:400:kworker.0 00000100:00100000:2.0:1788929881.066128:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929881.066254:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770120832 00000100:00100000:0.0:1788929881.066267:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770120832 00000100:00100000:0.0:1788929881.066318:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788929881.066328:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770120832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929881.066373:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770120832:12345-0@lo:400:kworker.0 Request processed in 47us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929881.066381:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788929881.066426:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e862c1180 x1875828770120832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929881.066440:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770120832:0@lo:400:kworker.0 00000100:00100000:1.0:1788929881.066667:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770120576:12345-0@lo:400:kworker.0 Request processed in 47us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929881.066676:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788929881.066711:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8870c000 x1875828770120576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929881.066721:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770120576:0@lo:400:kworker.0 00000100:00100000:1.0:1788929881.066743:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770120448 00000100:00100000:1.0:1788929881.066747:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770120448 00000100:00100000:1.0:1788929881.066784:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770120704 00000100:00100000:1.0:1788929881.066787:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770120704 00000100:00080000:2.0:1788929881.067045:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788929881.067051:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788929881.067093:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788929881.067112:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770120448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929881.067176:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770120448:12345-0@lo:400:kworker.0 Request processed in 75us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929881.067182:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788929881.067206:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788929881.067212:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770120704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929881.067286:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770120704:12345-0@lo:400:kworker.0 Request processed in 74us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929881.067292:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788929881.067335:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770120704:0@lo:400:kworker.0 00000100:00100000:2.0:1788929881.067698:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770120448:0@lo:400:kworker.0 00010000:00010000:0.0:1788929881.499455:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929881.565485:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770120960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788929881.565569:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929881.565768:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770120960 00000100:00100000:0.0:1788929881.565778:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770120960 00000100:00100000:0.0:1788929881.565831:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788929881.565840:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770120960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788929881.565878:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929881.565934:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770120960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929881.565941:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788929881.566017:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e862c1180 x1875828770120960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929881.566038:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770120960:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788929882.523793:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929883.101360:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788929883.101383:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770121088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788929883.101468:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929883.101676:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770121088 00000100:00100000:0.0:1788929883.101684:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770121088 00000100:00100000:0.0:1788929883.101751:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788929883.101759:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770121088:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788929883.101871:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788929883.101931:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929883.101990:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770121088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 231us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929883.101998:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788929883.102100:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8870c000 x1875828770121088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929883.102123:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770121088:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788929883.552126:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929884.572374:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929885.597455:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929885.659458:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929885.659500:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929885.659838:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747018880 00000100:00100000:1.0:1788929885.659849:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747018880 00000100:00100000:1.0:1788929885.659904:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 202 00000100:00100000:1.0:1788929885.659915:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2362:x1875828747018880:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929885.659985:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2362:x1875828747018880:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 71us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929885.659993:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 202 00000100:00100000:1.0:1788929885.660037:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747019008 00000100:00100000:1.0:1788929885.660041:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747019008 00000100:00100000:1.0:1788929885.660081:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 55 00000100:00100000:1.0:1788929885.660089:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747019008:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929885.660119:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747019008:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 31us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929885.660126:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 55 00000100:00080000:1.0:1788929885.660142:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788929886.172868:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770121600:0@lo:400:kworker.0 00000100:00100000:2.0:1788929886.172939:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929886.172991:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788929886.172998:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770121216:0@lo:400:kworker.0 00000100:00100000:2.0:1788929886.173040:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929886.173063:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770121728:0@lo:400:kworker.0 00000100:00100000:2.0:1788929886.173089:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929886.173115:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770121472:0@lo:400:kworker.0 00000100:00100000:2.0:1788929886.173137:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929886.173153:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788929886.173158:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770121344:0@lo:400:kworker.0 00000100:00100000:2.0:1788929886.173180:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929886.173193:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770121856:0@lo:400:kworker.0 00000100:00100000:2.0:1788929886.173213:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929886.173397:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770121728 00000100:00100000:1.0:1788929886.173406:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770121728 00000100:00100000:0.0:1788929886.173547:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770121600 00000100:00100000:0.0:1788929886.173552:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770121600 00000100:00100000:0.0:1788929886.173579:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770121856 00000100:00100000:0.0:1788929886.173582:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770121856 00000100:00100000:0.0:1788929886.173601:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788929886.173609:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770121600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929886.173663:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770121600:12345-0@lo:400:kworker.0 Request processed in 55us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929886.173670:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788929886.173686:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788929886.173693:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770121856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929886.173723:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770121856:12345-0@lo:400:kworker.0 Request processed in 31us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929886.173728:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788929886.173745:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770121472 00000100:00100000:0.0:1788929886.173749:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770121472 00000100:00100000:0.0:1788929886.173765:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770121344 00000100:00100000:0.0:1788929886.173767:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770121344 00000100:00100000:0.0:1788929886.173777:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788929886.173783:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770121728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929886.173823:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770121728:12345-0@lo:400:kworker.0 Request processed in 39us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929886.173829:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788929886.173842:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788929886.173848:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770121472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929886.173875:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770121472:12345-0@lo:400:kworker.0 Request processed in 27us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929886.173896:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788929886.173908:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788929886.173915:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770121344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929886.173943:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770121344:12345-0@lo:400:kworker.0 Request processed in 30us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929886.173949:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788929886.173990:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770121344:0@lo:400:kworker.0 00010000:00080000:0.0:1788929886.174003:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e86213480 x1875828770121856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929886.174027:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770121856:0@lo:400:kworker.0 00000100:00100000:0.0:1788929886.174039:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770121472:0@lo:400:kworker.0 00000100:00100000:0.0:1788929886.174439:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770121728:0@lo:400:kworker.0 00010000:00080000:0.0:1788929886.174450:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e86210700 x1875828770121600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929886.174617:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770121600:0@lo:400:kworker.0 00000100:00080000:2.0:1788929886.176518:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788929886.176528:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788929886.176532:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929886.177316:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770121216 00000100:00100000:0.0:1788929886.177327:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770121216 00000100:00100000:0.0:1788929886.177395:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788929886.177405:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770121216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929886.177506:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770121216:12345-0@lo:400:kworker.0 Request processed in 102us (4464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929886.177513:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788929886.177724:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770121216:0@lo:400:kworker.0 00010000:00010000:0.0:1788929886.619631:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929886.685187:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929886.685214:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770121984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788929886.685303:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929886.685382:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770121984 00000100:00100000:0.0:1788929886.685390:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770121984 00000100:00100000:0.0:1788929886.685444:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788929886.685453:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770121984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788929886.685491:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929886.685538:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770121984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929886.685545:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788929886.685584:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e862c0e00 x1875828770121984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929886.685604:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770121984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788929887.646170:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929888.219732:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788929888.219759:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770122112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788929888.219831:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929888.220069:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770122112 00000100:00100000:1.0:1788929888.220078:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770122112 00000100:00100000:1.0:1788929888.220151:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788929888.220159:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770122112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788929888.220195:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929888.220258:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770122112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (427us total) trans 0 rc 0/0 00000100:00080000:2.0:1788929888.220261:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788929888.220265:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788929888.222049:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8870d880 x1875828770122112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929888.222114:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770122112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788929888.668033:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929889.691354:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929890.716569:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929890.791322:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929890.791375:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929890.791412:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747019136 00000100:00100000:0.0:1788929890.791433:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747019136 00000100:00100000:0.0:1788929890.791484:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 204 00000100:00100000:0.0:1788929890.791495:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2362:x1875828747019136:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788929890.791573:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2362:x1875828747019136:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 80us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929890.791589:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 204 00000100:00100000:0.0:1788929890.791623:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747019264 00000100:00100000:0.0:1788929890.791626:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747019264 00000100:00100000:0.0:1788929890.791681:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 59 00000100:00100000:0.0:1788929890.791688:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747019264:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788929890.791724:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747019264:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 36us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929890.791731:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 59 00000100:00080000:2.0:1788929890.795460:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788929891.293703:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770122240:0@lo:400:kworker.0 00000100:00100000:3.0:1788929891.294003:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770122624:0@lo:400:kworker.0 00000100:00100000:1.0:1788929891.294060:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770122368:0@lo:400:kworker.0 00000100:00100000:2.0:1788929891.294097:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929891.294189:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770122240 00000100:00100000:0.0:1788929891.294201:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770122240 00000100:00100000:0.0:1788929891.294292:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788929891.294302:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770122240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929891.296549:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929891.296677:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770122624 00000100:00100000:3.0:1788929891.296691:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770122624 00000100:00100000:3.0:1788929891.296778:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788929891.296791:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770122624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929891.296869:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770122624:12345-0@lo:400:kworker.0 Request processed in 83us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929891.296876:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788929891.296896:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788929891.296940:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e862c0a80 x1875828770122624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929891.296955:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770122624:0@lo:400:kworker.0 00000100:00100000:3.0:1788929891.296998:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770122496:0@lo:400:kworker.0 00000100:00100000:3.0:1788929891.297031:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929891.297083:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770122496 00000100:00100000:3.0:1788929891.297088:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770122496 00000100:00100000:3.0:1788929891.297120:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788929891.297128:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770122496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929891.297381:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770122496:12345-0@lo:400:kworker.0 Request processed in 254us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929891.297389:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788929891.297405:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788929891.297423:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770122496:0@lo:400:kworker.0 00000100:00100000:1.0:1788929891.297537:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929891.297571:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770122880:0@lo:400:kworker.0 00000100:00100000:1.0:1788929891.297596:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929891.297633:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770122880 00000100:00100000:1.0:1788929891.297637:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770122880 00000100:00100000:1.0:1788929891.297670:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788929891.297677:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770122880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929891.297713:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770122880:12345-0@lo:400:kworker.0 Request processed in 37us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929891.297719:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788929891.297750:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788929891.297767:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e862c2a00 x1875828770122880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929891.297777:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770122880:0@lo:400:kworker.0 00000100:00100000:3.0:1788929891.298281:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770122368 00000100:00100000:3.0:1788929891.298286:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770122368 00000100:00100000:3.0:1788929891.298326:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788929891.298333:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770122368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929891.298372:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770122368:12345-0@lo:400:kworker.0 Request processed in 40us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929891.298377:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788929891.298495:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770122368:0@lo:400:kworker.0 00000100:00100000:2.0:1788929891.307336:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770122752:0@lo:400:kworker.0 00000100:00100000:2.0:1788929891.307414:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929891.310820:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770122752 00000100:00100000:3.0:1788929891.310843:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770122752 00000100:00100000:0.0:1788929891.311104:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770122240:12345-0@lo:400:kworker.0 Request processed in 16800us (17004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929891.311116:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788929891.311562:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788929891.311573:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770122752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929891.311625:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770122752:12345-0@lo:400:kworker.0 Request processed in 56us (4211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929891.311631:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788929891.311736:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770122240:0@lo:400:kworker.0 00000100:00100000:0.0:1788929891.311751:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770122752:0@lo:400:kworker.0 00000100:00080000:1.0:1788929891.318737:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788929891.739489:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929891.808550:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788929891.808575:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770123008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788929891.808646:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929891.809485:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770123008 00000100:00100000:0.0:1788929891.809498:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770123008 00000100:00100000:0.0:1788929891.809562:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788929891.809572:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770123008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788929891.809609:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929891.809677:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770123008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929891.809702:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788929891.809819:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e862c1180 x1875828770123008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929891.809841:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770123008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788929892.767831:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788929893.141533:0:10112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:58:10 (1788929890) === 00000100:00100000:3.0:1788929893.340590:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770123136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788929893.340661:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929893.341082:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770123136 00000100:00100000:1.0:1788929893.341090:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770123136 00000100:00100000:1.0:1788929893.341159:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788929893.341170:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770123136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788929893.341213:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929893.341285:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770123136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929893.341305:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788929893.341683:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb61cc380 x1875828770123136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929893.341704:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770123136:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788929893.342305:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788929893.569025:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929893.569327:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747019392 00000100:00100000:0.0:1788929893.569338:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747019392 00000100:00100000:0.0:1788929893.569394:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 206 00000100:00100000:0.0:1788929893.569404:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+10:8133:x1875828747019392:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788929893.569422:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929893.569440:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e80031400/0xce4472dd2237c995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca71640210103 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929893.569469:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e80031400/0xce4472dd2237c995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210103 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929893.569481:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e80031400/0xce4472dd2237c995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210103 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929893.569491:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e80031400, rc 0) 00000100:00100000:0.0:1788929893.571185:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+11:8133:x1875828747019392:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 1771us (2158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929893.571196:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 206 00000100:00100000:0.0:1788929893.576121:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929893.576218:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747019520 00000100:00100000:1.0:1788929893.576254:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747019520 00000100:00100000:1.0:1788929893.576309:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 207 00000100:00100000:1.0:1788929893.576329:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+11:8133:x1875828747019520:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788929893.576642:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+11:8133:x1875828747019520:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 322us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929893.576650:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 207 00000100:00100000:1.0:1788929893.578678:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929893.578815:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747019648 00000100:00100000:0.0:1788929893.578824:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747019648 00000100:00100000:0.0:1788929893.578888:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 208 00000100:00100000:0.0:1788929893.578897:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+11:8133:x1875828747019648:12345-192.168.204.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788929893.579117:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+11:8133:x1875828747019648:12345-192.168.204.40@tcp:503:mount.lustre.0 Request processed in 220us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929893.579135:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 208 00000100:00100000:2.0:1788929893.586203:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929893.586339:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747019776 00000100:00100000:3.0:1788929893.586364:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747019776 00000100:00100000:3.0:1788929893.586414:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 209 00000100:00100000:3.0:1788929893.586424:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+11:8137:x1875828747019776:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788929893.586794:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+11:8137:x1875828747019776:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 370us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929893.586801:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 209 00000100:00100000:3.0:1788929893.606698:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929893.606880:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747019904 00000100:00100000:1.0:1788929893.606892:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747019904 00000100:00100000:1.0:1788929893.606959:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 210 00000100:00100000:1.0:1788929893.606971:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+11:8137:x1875828747019904:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788929893.609146:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+11:8137:x1875828747019904:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 2160us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929893.609182:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 210 00000100:00100000:1.0:1788929893.620179:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929893.620267:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747020032 00000100:00100000:0.0:1788929893.620278:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747020032 00000100:00100000:0.0:1788929893.620396:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 211 00000100:00100000:0.0:1788929893.620408:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+11:8133:x1875828747020032:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788929893.620426:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929893.620444:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e80031200/0xce4472dd2237c99c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca7164021012d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929893.620474:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e80031200/0xce4472dd2237c99c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021012d expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929893.620487:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e80031200/0xce4472dd2237c99c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021012d expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929893.620497:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e80031200, rc 0) 00000100:00100000:0.0:1788929893.621079:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+12:8133:x1875828747020032:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 671us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929893.621088:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 211 00000100:00100000:2.0:1788929893.635680:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929893.636129:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747020160 00000100:00100000:1.0:1788929893.636143:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747020160 00000100:00100000:1.0:1788929893.636347:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 212 00000100:00100000:1.0:1788929893.636359:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+12:8133:x1875828747020160:12345-192.168.204.40@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788929893.636390:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788929893.636422:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788929893.636426:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788929893.636429:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788929893.636431:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788929893.644504:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+12:8133:x1875828747020160:12345-192.168.204.40@tcp:256:mount.lustre.0 Request processed in 8135us (8822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929893.644772:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 212 00000100:00100000:0.0:1788929893.649337:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929893.649464:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747020288 00000100:00100000:2.0:1788929893.649474:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747020288 00000100:00100000:2.0:1788929893.649551:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 213 00000100:00100000:2.0:1788929893.649564:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+12:8133:x1875828747020288:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788929893.649585:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929893.649607:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5340600/0xce4472dd2237c9a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca71640210134 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929893.649643:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5340600/0xce4472dd2237c9a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210134 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929893.649657:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5340600/0xce4472dd2237c9a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210134 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929893.649668:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340600, rc 0) 00000100:00100000:2.0:1788929893.649753:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:8133:x1875828747020288:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 191us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929893.649760:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 213 00000100:00100000:2.0:1788929893.654427:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929893.654539:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747020416 00000100:00100000:0.0:1788929893.654550:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747020416 00000100:00100000:0.0:1788929893.654610:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 214 00000100:00100000:0.0:1788929893.654622:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:8133:x1875828747020416:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788929893.655006:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:8133:x1875828747020416:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 385us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929893.655014:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 214 00000100:00100000:0.0:1788929893.671095:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929893.671178:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747020544 00000100:00100000:3.0:1788929893.671188:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747020544 00000100:00100000:3.0:1788929893.671271:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 215 00000100:00100000:3.0:1788929893.671283:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:8133:x1875828747020544:12345-192.168.204.40@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788929893.671646:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:8133:x1875828747020544:12345-192.168.204.40@tcp:503:mount.lustre.0 Request processed in 363us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929893.671654:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 215 00000100:00100000:0.0:1788929893.684025:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929893.684439:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747020672 00000100:00100000:2.0:1788929893.684451:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747020672 00000100:00100000:2.0:1788929893.684579:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 216 00000100:00100000:2.0:1788929893.684590:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:8139:x1875828747020672:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788929893.684924:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:8139:x1875828747020672:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 335us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929893.684932:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 216 00000100:00100000:0.0:1788929893.693553:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929893.693645:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747020800 00000100:00100000:1.0:1788929893.693658:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747020800 00000100:00100000:1.0:1788929893.693837:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 217 00000100:00100000:1.0:1788929893.693848:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:8139:x1875828747020800:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788929893.694194:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:8139:x1875828747020800:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 347us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929893.694203:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 217 00000100:00100000:0.0:1788929893.701431:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929893.701478:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929893.701725:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747021056 00000100:00100000:2.0:1788929893.701736:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747021056 00000100:00100000:2.0:1788929893.701818:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747020928 00000100:00100000:2.0:1788929893.701822:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747020928 00000100:00100000:2.0:1788929893.701838:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:2.0:1788929893.701850:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2359:x1875828747021056:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929893.701956:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2359:x1875828747021056:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 107us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929893.701963:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:2.0:1788929893.701984:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:2.0:1788929893.701989:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875828747020928:12345-192.168.204.40@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788929893.702016:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 8abb2367-c028-4bae-a29f-54a7e42177aa@192.168.204.40@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:2.0:1788929893.702053:0:5840:0:(genops.c:1384:class_connect()) connect: client 8abb2367-c028-4bae-a29f-54a7e42177aa, cookie 0xce4472dd2237c9aa 00000004:00100000:2.0:1788929893.702084:0:5840:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788929893.702399:0:5840:0:(import.c:65:import_set_state_nolock()) ffff8d2d8482d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788929893.702430:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+6:2358:x1875828747020928:12345-192.168.204.40@tcp:38:mount.lustre.0 Request processed in 439us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929893.702437:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00080000:3.0:1788929893.703288:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929893.713618:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929893.713723:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747021184 00000100:00100000:3.0:1788929893.713734:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747021184 00000100:00100000:3.0:1788929893.713820:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:3.0:1788929893.713832:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+6:0:x1875828747021184:12345-192.168.204.40@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788929893.713893:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788929893.713987:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+6:0:x1875828747021184:12345-192.168.204.40@tcp:41:mount.lustre.0 Request processed in 158us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929893.713995:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00080000:0.0:1788929893.714337:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929893.717477:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929893.717577:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747021312 00000100:00100000:1.0:1788929893.717587:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747021312 00000100:00100000:1.0:1788929893.717644:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:1.0:1788929893.717654:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+6:8133:x1875828747021312:12345-192.168.204.40@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788929893.717684:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788929893.717760:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+6:8133:x1875828747021312:12345-192.168.204.40@tcp:41:mount.lustre.0 Request processed in 108us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929893.717783:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:0.0:1788929893.728114:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929893.728274:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747021440 00000100:00100000:1.0:1788929893.728285:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747021440 00000100:00100000:1.0:1788929893.728347:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:1.0:1788929893.728358:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+6:8133:x1875828747021440:12345-192.168.204.40@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788929893.728471:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+6:8133:x1875828747021440:12345-192.168.204.40@tcp:40:mount.lustre.0 Request processed in 115us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929893.728479:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:0.0:1788929893.734173:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929893.734218:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929893.734313:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929893.734423:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747021568 00000100:00100000:2.0:1788929893.734435:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747021568 00000100:00100000:2.0:1788929893.734486:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747021696 00000100:00100000:2.0:1788929893.734489:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747021696 00000100:00100000:2.0:1788929893.734513:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:2.0:1788929893.734533:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875828747021568:12345-192.168.204.40@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788929893.734571:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8abb2367-c028-4bae-a29f-54a7e42177aa@192.168.204.40@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:2.0:1788929893.734609:0:6687:0:(genops.c:1384:class_connect()) connect: client 8abb2367-c028-4bae-a29f-54a7e42177aa, cookie 0xce4472dd2237c9b1 00002000:00100000:2.0:1788929893.734622:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8abb2367-c028-4bae-a29f-54a7e42177aa/ffff8d2d8482e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788929893.734635:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788929893.734933:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788929893.734969:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d2d84829800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788929893.735049:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+6:2358:x1875828747021568:12345-192.168.204.40@tcp:8:mount.lustre.0 Request processed in 515us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929893.735058:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:2.0:1788929893.735079:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:2.0:1788929893.735084:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875828747021696:12345-192.168.204.40@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788929893.735103:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8abb2367-c028-4bae-a29f-54a7e42177aa@192.168.204.40@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:2.0:1788929893.735123:0:6687:0:(genops.c:1384:class_connect()) connect: client 8abb2367-c028-4bae-a29f-54a7e42177aa, cookie 0xce4472dd2237c9b8 00002000:00100000:2.0:1788929893.735129:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8abb2367-c028-4bae-a29f-54a7e42177aa/ffff8d2d84828800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788929893.735147:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788929893.735297:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788929893.735602:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d2d8482d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788929893.735603:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747021824 00000100:00100000:1.0:1788929893.735609:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747021824 00000100:00100000:2.0:1788929893.735630:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+6:2358:x1875828747021696:12345-192.168.204.40@tcp:8:mount.lustre.0 Request processed in 545us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929893.735645:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:1.0:1788929893.735651:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+6:8133:x1875828747021824:12345-192.168.204.40@tcp:33:mount.lustre.0 00000100:00100000:2.0:1788929893.735654:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00000004:00200000:1.0:1788929893.735725:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788929893.735771:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+6:8133:x1875828747021824:12345-192.168.204.40@tcp:33:mount.lustre.0 Request processed in 119us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929893.735777:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1 00010000:00010000:0.0:1788929893.788079:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788929894.444893:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8abb2367-c028-4bae-a29f-54a7e42177aa 00010000:00010000:1.0:1788929894.811540:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788929895.498657:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8abb2367-c028-4bae-a29f-54a7e42177aa 00000001:00100000:2.0:1788929895.500447:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8abb2367-c028-4bae-a29f-54a7e42177aa 00010000:00010000:1.0:1788929895.845537:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929896.412266:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770123648:0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.412354:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929896.412427:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788929896.412434:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770123264:0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.412484:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929896.412506:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770123776:0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.412539:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929896.412582:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770123392:0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.412621:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929896.412639:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770123904:0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.412657:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929896.412961:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788929896.412968:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770123520:0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.413009:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929896.413047:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770123648 00000100:00100000:2.0:1788929896.413055:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770123648 00000100:00100000:2.0:1788929896.413121:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770123904 00000100:00100000:2.0:1788929896.413125:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770123904 00000100:00100000:2.0:1788929896.413167:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788929896.413178:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770123648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.413831:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770123648:12345-0@lo:400:kworker.0 Request processed in 79us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929896.413857:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788929896.413896:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788929896.413904:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770123904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.413964:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770123904:12345-0@lo:400:kworker.0 Request processed in 61us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929896.413970:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788929896.413992:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770123264 00000100:00100000:2.0:1788929896.413997:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770123264 00000100:00100000:2.0:1788929896.414043:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788929896.414050:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770123264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.414098:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770123264:12345-0@lo:400:kworker.0 Request processed in 49us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929896.414105:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788929896.414133:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770123776 00000100:00100000:2.0:1788929896.414137:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770123776 00000100:00100000:2.0:1788929896.414176:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770123392 00000100:00100000:2.0:1788929896.414180:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770123392 00000100:00100000:2.0:1788929896.414188:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770123520 00000100:00100000:2.0:1788929896.414191:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770123520 00000100:00100000:2.0:1788929896.414242:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788929896.414249:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770123776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.414300:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770123776:12345-0@lo:400:kworker.0 Request processed in 50us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929896.414306:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788929896.414318:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788929896.414324:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770123392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.414374:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770123392:12345-0@lo:400:kworker.0 Request processed in 50us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929896.414380:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788929896.414398:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788929896.414404:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770123520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.414441:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770123520:12345-0@lo:400:kworker.0 Request processed in 32us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929896.414447:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788929896.414524:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770123520:0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.414537:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770123392:0@lo:400:kworker.0 00010000:00080000:2.0:1788929896.414548:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e86213480 x1875828770123904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929896.414558:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770123904:0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.414587:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770123264:0@lo:400:kworker.0 00000100:00100000:2.0:1788929896.414597:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770123776:0@lo:400:kworker.0 00010000:00080000:2.0:1788929896.414607:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e86210e00 x1875828770123648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929896.414614:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770123648:0@lo:400:kworker.0 00000100:00080000:0.0:1788929896.421536:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788929896.421628:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788929896.421632:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788929896.862474:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929896.925570:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788929896.925593:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770124032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788929896.925668:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929896.925839:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770124032 00000100:00100000:0.0:1788929896.925847:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770124032 00000100:00100000:0.0:1788929896.925898:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788929896.925908:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770124032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788929896.925941:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929896.925998:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770124032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929896.926005:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788929896.926265:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefdf800 x1875828770124032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929896.926335:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770124032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788929897.883473:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929898.463833:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788929898.463864:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770124160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788929898.463945:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929898.464319:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770124160 00000100:00100000:0.0:1788929898.464328:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770124160 00000100:00100000:0.0:1788929898.464415:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788929898.464426:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770124160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788929898.464462:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929898.464523:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770124160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929898.464529:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788929898.465177:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefde680 x1875828770124160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929898.465202:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770124160:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788929898.466329:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788929898.908751:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929898.973528:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929898.973572:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929898.973621:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929898.973639:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929898.973672:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929898.973709:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747022080 00000100:00100000:0.0:1788929898.973718:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747022080 00000100:00100000:0.0:1788929898.973784:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747022208 00000100:00100000:0.0:1788929898.973788:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747022208 00000100:00100000:0.0:1788929898.973809:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 67 00000100:00100000:0.0:1788929898.973818:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747022080:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788929898.973892:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747022080:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 75us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929898.973900:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 67 00000100:00100000:0.0:1788929898.973916:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:0.0:1788929898.973923:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747022208:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788929898.973948:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747022208:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929898.973953:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00080000:0.0:1788929898.973982:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929898.974323:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747022336 00000100:00100000:1.0:1788929898.974328:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747022336 00000100:00100000:1.0:1788929898.974361:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747022464 00000100:00100000:1.0:1788929898.974364:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747022464 00000100:00100000:1.0:1788929898.974384:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:1.0:1788929898.974390:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747022336:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929898.974417:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747022336:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929898.974423:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:1.0:1788929898.974436:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:1.0:1788929898.974442:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747022464:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929898.974465:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747022464:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 23us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929898.974471:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:1.0:1788929898.974628:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747021952 00000100:00100000:1.0:1788929898.974632:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747021952 00000100:00100000:1.0:1788929898.974655:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 219 00000100:00100000:1.0:1788929898.974662:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747021952:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929898.974685:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747021952:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 24us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929898.974691:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 219 00000100:00080000:1.0:1788929898.974717:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788929898.974720:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788929899.690036:0:10308:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788929899.931432:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929900.957523:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929901.532742:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770124672:0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.532854:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929901.532932:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788929901.532939:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770124288:0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.532976:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929901.533004:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770124800:0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.533032:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929901.533061:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770124416:0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.533086:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929901.533103:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770124928:0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.533124:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929901.533145:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788929901.533151:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770124544:0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.533171:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929901.533253:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770124672 00000100:00100000:1.0:1788929901.533264:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770124672 00000100:00100000:1.0:1788929901.533334:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770124928 00000100:00100000:1.0:1788929901.533337:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770124928 00000100:00100000:1.0:1788929901.533364:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788929901.533377:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770124672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.533443:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770124672:12345-0@lo:400:kworker.0 Request processed in 70us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929901.533451:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788929901.533469:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788929901.533475:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770124928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.533507:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770124928:12345-0@lo:400:kworker.0 Request processed in 32us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929901.533524:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788929901.533546:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770124288 00000100:00100000:1.0:1788929901.533550:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770124288 00000100:00100000:1.0:1788929901.533576:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788929901.533583:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770124288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.533617:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770124288:12345-0@lo:400:kworker.0 Request processed in 34us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929901.533623:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788929901.533655:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770124800 00000100:00100000:1.0:1788929901.533659:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770124800 00000100:00100000:1.0:1788929901.533679:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770124416 00000100:00100000:1.0:1788929901.533682:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770124416 00000100:00100000:1.0:1788929901.533691:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770124544 00000100:00100000:1.0:1788929901.533693:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770124544 00000100:00100000:1.0:1788929901.533707:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788929901.533712:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770124800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.533755:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770124800:12345-0@lo:400:kworker.0 Request processed in 42us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929901.533761:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788929901.533772:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788929901.533779:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770124416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.533807:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770124416:12345-0@lo:400:kworker.0 Request processed in 29us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929901.533813:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788929901.533824:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788929901.533829:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770124544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.533869:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770124544:12345-0@lo:400:kworker.0 Request processed in 39us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929901.533875:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1788929901.533895:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788929901.533900:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788929901.533903:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788929901.533946:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770124544:0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.533960:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770124416:0@lo:400:kworker.0 00010000:00080000:1.0:1788929901.533974:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e90317800 x1875828770124928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929901.533986:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770124928:0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.534026:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770124288:0@lo:400:kworker.0 00000100:00100000:1.0:1788929901.534036:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770124800:0@lo:400:kworker.0 00010000:00080000:1.0:1788929901.534045:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e90317b80 x1875828770124672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929901.534053:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770124672:0@lo:400:kworker.0 00010000:00010000:1.0:1788929901.979430:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929902.062827:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929902.062859:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770125056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788929902.062958:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929902.064941:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770125056 00000100:00100000:0.0:1788929902.064967:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770125056 00000100:00100000:0.0:1788929902.065072:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788929902.065089:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770125056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788929902.065151:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929902.065288:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770125056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929902.065296:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788929902.065372:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefdf100 x1875828770125056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929902.065399:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770125056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788929903.003525:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929903.579668:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770125184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788929903.579771:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929903.579907:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770125184 00000100:00100000:0.0:1788929903.579915:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770125184 00000100:00100000:0.0:1788929903.579983:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788929903.579992:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770125184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788929903.580037:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929903.580085:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770125184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929903.580092:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788929903.580521:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788929903.580563:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefdf100 x1875828770125184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929903.580584:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770125184:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788929904.027484:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929904.092751:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929904.092791:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929904.092835:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929904.092861:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929904.092887:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929904.092916:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747022848 00000100:00100000:2.0:1788929904.092925:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747022848 00000100:00100000:2.0:1788929904.092979:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747022720 00000100:00100000:2.0:1788929904.092982:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747022720 00000100:00100000:2.0:1788929904.093001:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 72 00000100:00100000:2.0:1788929904.093010:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747022848:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929904.093083:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747022848:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 72us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929904.093091:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 72 00000100:00100000:2.0:1788929904.093111:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 73 00000100:00100000:2.0:1788929904.093129:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747022720:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929904.093153:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747022720:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 36us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929904.093159:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 73 00000100:00100000:2.0:1788929904.093191:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747023104 00000100:00100000:2.0:1788929904.093195:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747023104 00000100:00100000:2.0:1788929904.093246:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747022976 00000100:00100000:2.0:1788929904.093249:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747022976 00000100:00100000:2.0:1788929904.093272:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00100000:2.0:1788929904.093280:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747023104:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929904.093317:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747023104:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 38us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929904.093323:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00100000:2.0:1788929904.093341:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 44 00000100:00100000:2.0:1788929904.093346:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747022976:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929904.093366:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747022976:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 20us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929904.093371:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 44 00000100:00080000:2.0:1788929904.093384:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788929904.093387:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788929904.093390:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929904.093579:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747022592 00000100:00100000:1.0:1788929904.093583:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747022592 00000100:00100000:1.0:1788929904.093611:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 221 00000100:00100000:1.0:1788929904.093618:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747022592:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929904.093651:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747022592:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 34us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929904.093657:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 221 00010000:00010000:0.0:1788929905.055521:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929906.076573:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929906.654108:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770125696:0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.654179:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929906.654258:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788929906.654264:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770125312:0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.654295:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929906.654319:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770125824:0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.654345:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929906.654399:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770125440:0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.654425:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929906.654444:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770125952:0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.654491:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929906.654512:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788929906.654517:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770125568:0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.654543:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929906.654735:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770125696 00000100:00100000:1.0:1788929906.654744:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770125696 00000100:00100000:1.0:1788929906.654900:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770125952 00000100:00100000:1.0:1788929906.654917:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770125952 00000100:00100000:3.0:1788929906.654964:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788929906.654978:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770125696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929906.655033:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770125696:12345-0@lo:400:kworker.0 Request processed in 60us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929906.655040:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788929906.661708:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788929906.661719:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788929906.669560:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788929906.669583:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770125952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.669723:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770125952:12345-0@lo:400:kworker.0 Request processed in 148us (15230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929906.669731:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788929906.669761:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770125312 00000100:00100000:1.0:1788929906.669770:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770125312 00000100:00100000:1.0:1788929906.669795:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788929906.669801:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770125312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.669834:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770125312:12345-0@lo:400:kworker.0 Request processed in 32us (15538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929906.669840:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788929906.669870:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770125824 00000100:00100000:1.0:1788929906.669875:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770125824 00000100:00100000:1.0:1788929906.669896:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770125440 00000100:00100000:1.0:1788929906.669899:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770125440 00000100:00100000:1.0:1788929906.669908:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770125568 00000100:00100000:1.0:1788929906.669910:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770125568 00000100:00100000:1.0:1788929906.669926:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788929906.669932:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770125824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.669966:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770125824:12345-0@lo:400:kworker.0 Request processed in 34us (15620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929906.669971:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788929906.669981:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788929906.669987:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770125440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.670012:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770125440:12345-0@lo:400:kworker.0 Request processed in 26us (15587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929906.670027:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788929906.670040:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788929906.670045:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770125568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.670073:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770125568:12345-0@lo:400:kworker.0 Request processed in 28us (15530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929906.670078:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788929906.670126:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770125312:0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.670142:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770125824:0@lo:400:kworker.0 00000100:00080000:2.0:1788929906.670381:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788929906.671315:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e90317b80 x1875828770125696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929906.671334:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770125696:0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.671384:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770125568:0@lo:400:kworker.0 00000100:00100000:1.0:1788929906.671396:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770125440:0@lo:400:kworker.0 00010000:00080000:1.0:1788929906.671410:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e90317800 x1875828770125952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929906.671420:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770125952:0@lo:400:kworker.0 00010000:00010000:1.0:1788929907.099446:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929907.165001:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770126080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788929907.165079:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929907.165470:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770126080 00000100:00100000:0.0:1788929907.165493:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770126080 00000100:00100000:0.0:1788929907.165553:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788929907.165563:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770126080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788929907.165600:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929907.165662:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770126080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929907.165669:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788929907.172332:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefddc00 x1875828770126080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929907.172368:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770126080:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788929908.145913:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929908.707925:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788929908.707950:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770126208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788929908.708045:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929908.713467:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770126208 00000100:00100000:2.0:1788929908.713488:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770126208 00000100:00100000:2.0:1788929908.713595:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788929908.713608:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770126208:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788929908.713625:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788929908.713651:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929908.713749:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770126208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (5704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929908.713756:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788929908.713799:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefdd880 x1875828770126208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929908.713826:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770126208:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788929909.148188:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929909.226070:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929909.226152:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929909.226184:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929909.226206:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929909.226266:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929909.226306:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747023488 00000100:00100000:3.0:1788929909.226316:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747023488 00000100:00100000:3.0:1788929909.226380:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747023360 00000100:00100000:3.0:1788929909.226384:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747023360 00000100:00100000:3.0:1788929909.226407:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:2.0:1788929909.226411:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747023232 00000100:00100000:2.0:1788929909.226415:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747023232 00000100:00100000:3.0:1788929909.226417:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2359:x1875828747023488:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929909.226449:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 223 00000100:00100000:2.0:1788929909.226456:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2359:x1875828747023232:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929909.226485:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2359:x1875828747023232:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929909.226507:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 223 00000100:00100000:3.0:1788929909.227464:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2359:x1875828747023488:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 1044us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929909.227474:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:3.0:1788929909.227492:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:3.0:1788929909.227503:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2359:x1875828747023360:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929909.227553:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2359:x1875828747023360:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 53us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929909.227560:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:3.0:1788929909.227594:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747023744 00000100:00100000:3.0:1788929909.227599:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747023744 00000100:00100000:3.0:1788929909.227642:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747023616 00000100:00100000:3.0:1788929909.227646:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747023616 00000100:00100000:3.0:1788929909.227670:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 47 00000100:00100000:3.0:1788929909.227678:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2359:x1875828747023744:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929909.227705:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2359:x1875828747023744:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929909.227712:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 47 00000100:00100000:3.0:1788929909.227724:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00100000:3.0:1788929909.227730:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2359:x1875828747023616:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929909.227768:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2359:x1875828747023616:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 37us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929909.227784:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00080000:1.0:1788929909.228976:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788929909.228983:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788929909.228986:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788929910.171479:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929911.211345:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929911.776433:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770126720:0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.776498:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929911.776561:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788929911.776567:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770126336:0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.776594:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929911.776615:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770126848:0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.776651:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929911.776678:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770126464:0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.776699:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929911.776715:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770126976:0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.776733:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929911.776750:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788929911.776754:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770126592:0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.776772:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929911.776801:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770126720 00000100:00100000:3.0:1788929911.776811:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770126720 00000100:00100000:3.0:1788929911.776865:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770126976 00000100:00100000:3.0:1788929911.776868:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770126976 00000100:00100000:3.0:1788929911.776891:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788929911.776901:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770126720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.776955:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770126720:12345-0@lo:400:kworker.0 Request processed in 57us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929911.776961:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788929911.776980:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788929911.776993:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770126976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.777024:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770126976:12345-0@lo:400:kworker.0 Request processed in 33us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929911.777029:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788929911.777046:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770126336 00000100:00100000:3.0:1788929911.777048:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770126336 00000100:00100000:3.0:1788929911.777071:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788929911.777076:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770126336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.777099:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770126336:12345-0@lo:400:kworker.0 Request processed in 23us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929911.777104:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788929911.777127:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770126848 00000100:00100000:3.0:1788929911.777130:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770126848 00000100:00100000:3.0:1788929911.777147:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770126464 00000100:00100000:3.0:1788929911.777149:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770126464 00000100:00100000:3.0:1788929911.777157:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770126592 00000100:00100000:3.0:1788929911.777159:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770126592 00000100:00100000:3.0:1788929911.777170:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788929911.777174:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770126848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.777198:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770126848:12345-0@lo:400:kworker.0 Request processed in 24us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929911.777203:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788929911.777212:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788929911.777217:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770126464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.777261:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770126464:12345-0@lo:400:kworker.0 Request processed in 44us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929911.777266:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788929911.777284:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788929911.777289:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770126592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.777318:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770126592:12345-0@lo:400:kworker.0 Request processed in 29us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929911.777322:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788929911.777347:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788929911.777350:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788929911.777352:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788929911.777388:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770126592:0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.777399:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770126464:0@lo:400:kworker.0 00010000:00080000:3.0:1788929911.777410:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85551880 x1875828770126976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929911.777420:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770126976:0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.777445:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770126336:0@lo:400:kworker.0 00000100:00100000:3.0:1788929911.777453:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770126848:0@lo:400:kworker.0 00010000:00080000:3.0:1788929911.777462:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85552680 x1875828770126720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929911.777469:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770126720:0@lo:400:kworker.0 00010000:00010000:2.0:1788929912.222662:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929912.319974:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770127104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788929912.320096:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929912.320168:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770127104 00000100:00100000:0.0:1788929912.320175:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770127104 00000100:00100000:0.0:1788929912.320257:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788929912.320267:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770127104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788929912.320308:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929912.320355:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770127104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929912.320362:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788929912.320399:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefde680 x1875828770127104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929912.320418:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770127104:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788929913.243581:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929913.823588:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788929913.823622:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770127232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788929913.823706:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929913.823790:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770127232 00000100:00100000:0.0:1788929913.823887:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770127232 00000100:00100000:0.0:1788929913.823973:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788929913.823983:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770127232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788929913.824020:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929913.824076:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770127232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929913.824083:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788929913.824146:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788929913.824387:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefde680 x1875828770127232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929913.824409:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770127232:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788929914.276439:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929914.331730:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929914.331771:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929914.332044:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747024256 00000100:00100000:0.0:1788929914.332057:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747024256 00000100:00100000:0.0:1788929914.332131:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747024384 00000100:00100000:0.0:1788929914.332134:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747024384 00000100:00100000:0.0:1788929914.332175:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:0.0:1788929914.332185:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2358:x1875828747024256:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:0.0:1788929914.332217:0:6989:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c9b1 00000100:00080000:0.0:1788929914.332258:0:6989:0:(import.c:65:import_set_state_nolock()) ffff8d2d84829800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788929914.332295:0:6989:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788929914.332812:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+2:2358:x1875828747024256:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 627us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929914.332819:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:0.0:1788929914.332836:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:0.0:1788929914.332843:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2358:x1875828747024384:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:0.0:1788929914.332856:0:6989:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c9b8 00000100:00080000:0.0:1788929914.332863:0:6989:0:(import.c:65:import_set_state_nolock()) ffff8d2d8482d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788929914.332884:0:6989:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788929914.333099:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+2:2358:x1875828747024384:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 255us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929914.333106:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 16 00010000:00010000:0.0:1788929914.333143:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788929914.333474:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788929914.333489:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788929914.333583:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929914.334901:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929914.334944:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929914.334966:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929914.334988:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747024128 00000100:00100000:2.0:1788929914.334996:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747024128 00000100:00100000:2.0:1788929914.335043:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747024000 00000100:00100000:2.0:1788929914.335046:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747024000 00000100:00100000:2.0:1788929914.335066:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00100000:2.0:1788929914.335075:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747024128:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929914.335133:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747024128:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 59us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929914.335141:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00100000:2.0:1788929914.335168:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:2.0:1788929914.335175:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747024000:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929914.335200:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747024000:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929914.335207:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00080000:2.0:1788929914.335266:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788929914.335490:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747023872 00000100:00100000:3.0:1788929914.335495:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747023872 00000100:00100000:3.0:1788929914.335531:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 225 00000100:00100000:3.0:1788929914.335539:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747023872:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929914.335586:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747023872:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 47us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929914.335593:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 225 00010000:00010000:3.0:1788929915.293592:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788929916.026599:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8abb2367-c028-4bae-a29f-54a7e42177aa 00000020:00000080:3.0:1788929916.026610:0:7639:0:(genops.c:885:class_export_put()) final put ffff8d2d84828800/8abb2367-c028-4bae-a29f-54a7e42177aa 00000020:00000080:0.0:1788929916.028178:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84828800/8abb2367-c028-4bae-a29f-54a7e42177aa for lustre-OST0001 00000020:00000080:3.0:1788929916.029361:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d8482d800 for lustre-OST0001 00000001:00100000:2.0:1788929916.032303:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8abb2367-c028-4bae-a29f-54a7e42177aa 00000020:00000080:2.0:1788929916.032320:0:6716:0:(genops.c:885:class_export_put()) final put ffff8d2d8482e000/8abb2367-c028-4bae-a29f-54a7e42177aa 00000020:00000080:0.0:1788929916.032625:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d8482e000/8abb2367-c028-4bae-a29f-54a7e42177aa for lustre-OST0000 00000020:00000080:0.0:1788929916.032677:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d84829800 for lustre-OST0000 00010000:00010000:0.0:1788929916.327639:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929916.891610:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770127616:0@lo:400:kworker.0 00000100:00100000:2.0:1788929916.891744:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929916.891812:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788929916.891819:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770127488:0@lo:400:kworker.0 00000100:00100000:2.0:1788929916.891842:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929916.891860:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770128000:0@lo:400:kworker.0 00000100:00100000:2.0:1788929916.891885:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929916.891922:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770127616 00000100:00100000:2.0:1788929916.891930:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770127616 00000100:00100000:2.0:1788929916.891980:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770127488 00000100:00100000:2.0:1788929916.891983:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770127488 00000100:00100000:2.0:1788929916.892000:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788929916.892008:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770127616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929916.892058:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770127616:12345-0@lo:400:kworker.0 Request processed in 50us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929916.892065:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788929916.892085:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788929916.892091:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770127488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929916.892116:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770127488:12345-0@lo:400:kworker.0 Request processed in 26us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929916.892121:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788929916.892142:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770128000 00000100:00100000:2.0:1788929916.892145:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770128000 00000100:00100000:2.0:1788929916.892174:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788929916.892180:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770128000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929916.892209:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770128000:12345-0@lo:400:kworker.0 Request processed in 29us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929916.892214:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788929916.892248:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788929916.892257:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929916.892482:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770127360:0@lo:400:kworker.0 00000100:00100000:1.0:1788929916.892521:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929916.892551:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770127872:0@lo:400:kworker.0 00000100:00100000:1.0:1788929916.892576:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929916.892595:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788929916.892601:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770127744:0@lo:400:kworker.0 00000100:00100000:1.0:1788929916.892622:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929916.892649:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770127360 00000100:00100000:1.0:1788929916.892726:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770127360 00000100:00100000:1.0:1788929916.892758:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788929916.892765:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770127360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929916.892801:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770127360:12345-0@lo:400:kworker.0 Request processed in 37us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929916.892808:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788929916.892861:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770127360:0@lo:400:kworker.0 00000100:00100000:2.0:1788929916.893609:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770127488:0@lo:400:kworker.0 00010000:00080000:2.0:1788929916.893624:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e86211180 x1875828770128000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929916.893635:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770128000:0@lo:400:kworker.0 00000100:00100000:2.0:1788929916.893646:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770127616:0@lo:400:kworker.0 00000100:00100000:2.0:1788929916.894058:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770127744 00000100:00100000:2.0:1788929916.894065:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770127744 00000100:00100000:2.0:1788929916.894127:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788929916.894135:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770127744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929916.894198:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770127744:12345-0@lo:400:kworker.0 Request processed in 63us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929916.894205:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788929916.894260:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e86212a00 x1875828770127744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929916.894270:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770127744:0@lo:400:kworker.0 00000100:00080000:0.0:1788929916.895670:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788929916.897113:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770127872 00000100:00100000:3.0:1788929916.897128:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770127872 00000100:00100000:3.0:1788929916.897209:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788929916.897218:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770127872:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788929916.898601:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788929916.898975:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770127872:12345-0@lo:400:kworker.0 Request processed in 1754us (6393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929916.898986:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788929916.899249:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770127872:0@lo:400:kworker.0 00010000:00010000:3.0:1788929917.348602:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929917.403650:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770128128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788929917.403737:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929917.403978:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770128128 00000100:00100000:3.0:1788929917.403989:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770128128 00000100:00100000:3.0:1788929917.404055:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788929917.404065:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770128128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788929917.404110:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929917.414679:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770128128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10604us (10931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929917.414696:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788929917.415081:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefde680 x1875828770128128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929917.415106:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770128128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788929918.375094:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929918.939779:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770128256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788929918.939874:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929918.940088:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770128256 00000100:00100000:1.0:1788929918.940096:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770128256 00000100:00100000:1.0:1788929918.940155:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788929918.940164:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770128256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788929918.940196:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929918.940266:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770128256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929918.940274:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788929918.940315:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e863ff100 x1875828770128256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929918.940334:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770128256:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788929918.940998:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788929919.389070:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929919.449345:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929919.449411:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929919.449435:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747024640 00000100:00100000:0.0:1788929919.449446:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747024640 00000100:00100000:2.0:1788929919.449459:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929919.449520:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00100000:0.0:1788929919.449532:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2361:x1875828747024640:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788929919.449619:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2361:x1875828747024640:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 89us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929919.449627:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00080000:0.0:1788929919.449653:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929919.449890:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747024512 00000100:00100000:1.0:1788929919.449895:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747024512 00000100:00100000:1.0:1788929919.449939:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 227 00000100:00100000:1.0:1788929919.449947:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2361:x1875828747024512:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929919.449987:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2361:x1875828747024512:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 41us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929919.449993:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 227 00000100:00100000:2.0:1788929919.450213:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747024768 00000100:00100000:2.0:1788929919.450217:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747024768 00000100:00100000:2.0:1788929919.450265:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 88 00000100:00100000:2.0:1788929919.450271:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2361:x1875828747024768:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929919.450299:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2361:x1875828747024768:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929919.450304:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 88 00000100:00080000:0.0:1788929919.451125:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788929920.414143:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788929921.121710:0:11011:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788929921.437555:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929922.011986:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770128640:0@lo:400:kworker.0 00000100:00100000:0.0:1788929922.012067:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929922.012135:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788929922.012142:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770128512:0@lo:400:kworker.0 00000100:00100000:0.0:1788929922.012165:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929922.012182:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770129024:0@lo:400:kworker.0 00000100:00100000:0.0:1788929922.012205:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929922.012263:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770128640 00000100:00100000:0.0:1788929922.012270:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770128640 00000100:00100000:0.0:1788929922.012320:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770128512 00000100:00100000:0.0:1788929922.012329:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770128512 00000100:00100000:0.0:1788929922.012364:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788929922.012372:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770128640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929922.012423:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770128640:12345-0@lo:400:kworker.0 Request processed in 51us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929922.012430:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788929922.012535:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770128384:0@lo:400:kworker.0 00000100:00100000:3.0:1788929922.012570:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929922.012593:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770128896:0@lo:400:kworker.0 00000100:00100000:3.0:1788929922.012614:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929922.012626:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788929922.012631:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770128768:0@lo:400:kworker.0 00000100:00100000:3.0:1788929922.012648:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929922.012687:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770129024 00000100:00100000:3.0:1788929922.012691:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770129024 00000100:00100000:3.0:1788929922.012722:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770128768 00000100:00100000:3.0:1788929922.012725:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770128768 00000100:00100000:3.0:1788929922.012743:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788929922.012752:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770129024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929922.012784:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770129024:12345-0@lo:400:kworker.0 Request processed in 35us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929922.012790:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788929922.012806:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788929922.012812:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770128768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929922.012841:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770128768:12345-0@lo:400:kworker.0 Request processed in 30us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929922.012848:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788929922.012886:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebefde680 x1875828770128768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929922.012899:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770128768:0@lo:400:kworker.0 00000100:00100000:3.0:1788929922.012945:0:5840:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788929922.012960:0:5840:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1788929922.012976:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788929922.012979:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788929922.012982:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788929922.012995:0:5841:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788929922.013000:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770128896 00000100:00100000:3.0:1788929922.013003:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770128896 00000100:00100000:1.0:1788929922.013654:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770128384 00000100:00100000:1.0:1788929922.013662:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770128384 00000100:00100000:1.0:1788929922.013701:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788929922.013709:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770128384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929922.014171:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770128384:12345-0@lo:400:kworker.0 Request processed in 461us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929922.014276:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788929922.014370:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770128384:0@lo:400:kworker.0 00000100:00080000:1.0:1788929922.015310:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788929922.015370:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebc4c0380 x1875828770129024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929922.015386:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770129024:0@lo:400:kworker.0 00000100:00100000:1.0:1788929922.015403:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770128640:0@lo:400:kworker.0 00000100:00100000:3.0:1788929922.017991:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788929922.018010:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770128512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929922.018107:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770128512:12345-0@lo:400:kworker.0 Request processed in 105us (5940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929922.018116:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788929922.018135:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788929922.018144:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770128896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929922.018182:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770128896:12345-0@lo:400:kworker.0 Request processed in 40us (5567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929922.018189:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788929922.018257:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770128896:0@lo:400:kworker.0 00000100:00100000:3.0:1788929922.018296:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770128512:0@lo:400:kworker.0 00010000:00010000:0.0:1788929922.459677:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929922.527934:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770129152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788929922.528029:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929922.528115:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770129152 00000100:00100000:0.0:1788929922.528125:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770129152 00000100:00100000:0.0:1788929922.528179:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788929922.528189:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770129152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788929922.528244:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929922.528297:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770129152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929922.528305:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788929922.528445:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebc4c0700 x1875828770129152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929922.528468:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770129152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788929923.483633:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929924.059636:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770129280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788929924.059715:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929924.060657:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770129280 00000100:00100000:1.0:1788929924.060668:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770129280 00000100:00100000:1.0:1788929924.060741:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788929924.060751:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770129280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788929924.060791:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929924.060853:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770129280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929924.060861:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788929924.061016:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788929924.061053:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e863ff100 x1875828770129280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929924.061076:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770129280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788929924.510334:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788929924.568935:0:11159:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbb0bbf10 20000000:00000080:0.0:1788929924.568954:0:11159:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2ebcb34400 uarg=0000000000000000 20000000:01000000:0.0:1788929924.569121:0:11159:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788929924.569127:0:11159:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788929924.569132:0:11159:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788929924.570555:0:11160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788929924.570703:0:11159:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 00000100:00100000:2.0:1788929924.576958:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929924.578346:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929924.578390:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929924.578465:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747025152 00000100:00100000:1.0:1788929924.578474:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747025152 00000100:00100000:1.0:1788929924.578550:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747025024 00000100:00100000:1.0:1788929924.578554:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747025024 00000100:00100000:1.0:1788929924.578578:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 92 00000100:00100000:1.0:1788929924.578589:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2359:x1875828747025152:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929924.578663:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2359:x1875828747025152:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 76us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929924.578671:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 92 00000100:00100000:1.0:1788929924.578690:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 93 00000100:00100000:1.0:1788929924.578697:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2359:x1875828747025024:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929924.578724:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2359:x1875828747025024:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929924.578730:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 93 00000100:00080000:2.0:1788929924.578974:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1788929924.579125:0:11159:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788929924.579219:0:11159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.579267:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ebc596800/0xce4472dd2237c96b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c964 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.579276:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2eb5341600/0xce4472dd2237c979 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c972 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.579294:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2eb5341000/0xce4472dd2237c987 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c980 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.579304:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2eb5341800/0xce4472dd2237c98e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100fc expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.579311:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2eb5340600/0xce4472dd2237c9a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210134 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.579319:0:11159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.579361:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2eb5340600/0xce4472dd2237c9a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210134 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.579374:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2eb5340600/0xce4472dd2237c9a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210134 expref: 12 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929924.579388:0:11159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875828770129408:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929924.579485:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2eb5341800/0xce4472dd2237c98e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402100fc expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.579507:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2eb5341800/0xce4472dd2237c98e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402100fc expref: 12 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929924.579515:0:11159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875828770129536:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929924.579550:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2eb5341000/0xce4472dd2237c987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c980 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.579559:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2eb5341000/0xce4472dd2237c987 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c980 expref: 18 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929924.579568:0:11159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875828770129664:0@lo:104: 00000100:00100000:0.0:1788929924.579598:0:11159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929924.579624:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770129664 00000100:00100000:0.0:1788929924.579629:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770129664 00000100:00100000:0.0:1788929924.579660:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788929924.579667:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:11159:x1875828770129664:12345-0@lo:104: 00010000:00010000:0.0:1788929924.579678:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c987 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.579717:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788929924.579723:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:11159:x1875828770129664:12345-0@lo:104: Request processed in 57us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929924.579729:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788929924.580637:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788929924.580644:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c987 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.580664:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340800 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788929924.580668:0:7628:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c987 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.580676:0:7628:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c987 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788929924.580684:0:7628:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c987 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929924.580690:0:7628:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788929924.580776:0:7628:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c987 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.580886:0:7628:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788929924.580913:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c987 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.580920:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340800/0xce4472dd2237c980 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c987 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.580934:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929924.580936:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929924.580937:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929924.580977:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2eb5341600/0xce4472dd2237c979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c972 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.580987:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2eb5341600/0xce4472dd2237c979 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c972 expref: 18 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929924.581020:0:11159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875828770129920:0@lo:104: 00000100:00100000:0.0:1788929924.581058:0:11159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788929924.581086:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ebc596800/0xce4472dd2237c96b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c964 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.581095:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ebc596800/0xce4472dd2237c96b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c964 expref: 18 pid: 5831 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929924.581104:0:11159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875828770130048:0@lo:104: 00000100:00100000:0.0:1788929924.581124:0:11159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929924.581146:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770129920 00000100:00100000:0.0:1788929924.581151:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770129920 00000100:00100000:0.0:1788929924.581178:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770130048 00000100:00100000:0.0:1788929924.581181:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770130048 00000100:00100000:0.0:1788929924.581197:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788929924.581204:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+4:11159:x1875828770129920:12345-0@lo:104: 00010000:00010000:0.0:1788929924.581213:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c979 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.581279:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788929924.581298:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+4:11159:x1875828770129920:12345-0@lo:104: Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929924.581305:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788929924.581321:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788929924.581327:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:11159:x1875828770130048:12345-0@lo:104: 00010000:00010000:0.0:1788929924.581335:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c96b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.581376:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788929924.581381:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:11159:x1875828770130048:12345-0@lo:104: Request processed in 55us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929924.581387:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788929924.581406:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788929924.581411:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c979 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.581417:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596a00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788929924.581421:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c979 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.581429:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c979 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788929924.581435:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c979 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788929924.581441:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788929924.581498:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770129792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788929924.581531:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788929924.581570:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788929924.581575:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c96b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.581582:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784400 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788929924.581585:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c96b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.581592:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c96b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788929924.581598:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c96b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929924.581615:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788929924.581993:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747024896 00000100:00100000:3.0:1788929924.581999:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747024896 00000100:00100000:3.0:1788929924.582043:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 229 00000100:00100000:3.0:1788929924.582051:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2359:x1875828747024896:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929924.582106:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2359:x1875828747024896:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 56us (5159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929924.582113:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 229 00010000:00010000:0.0:1788929924.582407:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c979 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.582415:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788929924.582432:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c979 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.582439:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237c972 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c979 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.582460:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929924.582461:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929924.582463:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929924.582474:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770130176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788929924.582505:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929924.582544:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770129792 00000100:00100000:0.0:1788929924.582548:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770129792 00010000:00010000:0.0:1788929924.582566:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2eb5341000/0xce4472dd2237c987 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c980 expref: 19 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929924.582584:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770130176 00000100:00100000:0.0:1788929924.582587:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770130176 00010000:00010000:0.0:1788929924.582596:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2eb5341600/0xce4472dd2237c979 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c972 expref: 20 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929924.582613:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788929924.582619:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+20:3309:x1875828770129792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788929924.582632:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929924.582637:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2eb5341000/0xce4472dd2237c987 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c980 expref: 20 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.582647:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2eb5341000/0xce4472dd2237c987 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c980 expref: 20 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.582663:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929924.582691:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+20:3309:x1875828770129792:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929924.582698:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788929924.582738:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788929924.582744:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3310:x1875828770130176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788929924.582934:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929924.582939:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2eb5341600/0xce4472dd2237c979 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c972 expref: 19 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.582948:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2eb5341600/0xce4472dd2237c979 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c972 expref: 19 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.582958:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929924.583435:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3310:x1875828770130176:12345-0@lo:103:ldlm_bl.0 Request processed in 689us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929924.583443:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788929924.583473:0:11159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e93f00f00 going to sleep for 11 seconds 00010000:00010000:0.0:1788929924.583496:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5341000/0xce4472dd2237c987 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c980 expref: 18 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929924.583507:0:11159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875828770129664:0@lo:104: 00010000:00010000:0.0:1788929924.583516:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5341600/0xce4472dd2237c979 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c972 expref: 17 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929924.583524:0:11159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875828770129920:0@lo:104: 00000100:00100000:0.0:1788929924.583531:0:11159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875828770130048:0@lo:104: 00000100:00100000:3.0:1788929924.583677:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770130176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788929924.583769:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c96b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.583776:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788929924.583792:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c96b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.583798:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c964 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c96b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.583812:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929924.583813:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929924.583815:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929924.583845:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770129792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788929924.583861:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788929924.583868:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770130304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788929924.583898:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929924.584220:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770130304 00000100:00100000:1.0:1788929924.584249:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770130304 00010000:00010000:1.0:1788929924.584270:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ebc596800/0xce4472dd2237c96b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c964 expref: 17 pid: 5831 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929924.584304:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788929924.584312:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:3310:x1875828770130304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788929924.584322:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929924.584327:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ebc596800/0xce4472dd2237c96b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c964 expref: 17 pid: 5831 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.584347:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ebc596800/0xce4472dd2237c96b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c964 expref: 17 pid: 5831 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.584358:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc596800/0xce4472dd2237c96b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c964 expref: 17 pid: 5831 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.584369:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929924.584395:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3310:x1875828770130304:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929924.584402:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788929924.584430:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770130304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788929924.584601:0:11159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875828770129408:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929924.584610:0:11159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875828770129536:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929924.584634:0:11159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929924.585866:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929924.585896:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929924.586305:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747025280 00000100:00100000:1.0:1788929924.586313:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747025280 00010000:00010000:1.0:1788929924.586343:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2eb5340600/0xce4472dd2237c9a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210134 expref: 13 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929924.586371:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747025408 00000100:00100000:1.0:1788929924.586374:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747025408 00010000:00010000:1.0:1788929924.586384:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2eb5341800/0xce4472dd2237c98e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402100fc expref: 14 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929924.586401:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 28 00000100:00100000:1.0:1788929924.586410:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32bd5a92-c2e2-4642-929e-29df1e036b64+14:2361:x1875828747025280:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929924.586422:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929924.586426:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2eb5340600/0xce4472dd2237c9a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210134 expref: 14 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586436:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2eb5340600/0xce4472dd2237c9a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210134 expref: 14 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586462:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5340600/0xce4472dd2237c9a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210134 expref: 14 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586478:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929924.586525:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2361:x1875828747025280:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 116us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929924.586533:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 28 00000100:00100000:1.0:1788929924.586548:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 29 00000100:00100000:1.0:1788929924.586554:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32bd5a92-c2e2-4642-929e-29df1e036b64+12:2361:x1875828747025408:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929924.586561:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929924.586565:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2eb5341800/0xce4472dd2237c98e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402100fc expref: 12 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586572:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2eb5341800/0xce4472dd2237c98e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402100fc expref: 12 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586582:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5341800/0xce4472dd2237c98e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402100fc expref: 12 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586594:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586602:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586618:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586636:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586644:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586651:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586657:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e80030a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788929924.586662:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586671:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586683:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929924.586693:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929924.586714:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32bd5a92-c2e2-4642-929e-29df1e036b64+11:2361:x1875828747025408:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 160us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929924.586721:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 29 00010000:00010000:0.0:1788929924.586843:0:11159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.586851:0:11159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929924.586858:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e80030a00/0xce4472dd2237c9bf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929925.531681:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788929925.984508:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788929925.984517:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2d85d86800 from 7 10000000:01000000:3.0:1788929925.984523:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788929925.984576:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.984589:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.984705:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929925.984739:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770130432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788929925.984814:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929925.984939:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d81085480 going to sleep for 11 seconds 00000100:00100000:2.0:1788929925.985002:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770130432 00000100:00100000:2.0:1788929925.985011:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770130432 00000100:00100000:2.0:1788929925.985071:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788929925.985079:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770130432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788929925.985092:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929925.985172:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5341c00/0xce4472dd2237c9cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c9c6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929925.985194:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5341c00/0xce4472dd2237c9cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c9c6 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929925.985204:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5341c00/0xce4472dd2237c9cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c9c6 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929925.985213:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341c00, rc 0) 00000100:00100000:2.0:1788929925.985458:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770130432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 379us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929925.985467:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788929925.985588:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770130432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929925.985670:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c9cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.985680:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c9cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929925.985737:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770130560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929925.985765:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929925.985835:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d81085480 going to sleep for 11 seconds 00000100:00100000:1.0:1788929925.985934:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770130560 00000100:00100000:1.0:1788929925.985939:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770130560 00000100:00100000:1.0:1788929925.986007:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788929925.986016:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770130560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788929925.986782:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770130560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 765us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929925.986800:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788929925.986932:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770130560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929925.986973:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770130688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929925.987018:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929925.987082:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d81085480 going to sleep for 11 seconds 00000100:00100000:2.0:1788929925.987179:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770130688 00000100:00100000:2.0:1788929925.987185:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770130688 00000100:00100000:2.0:1788929925.987341:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788929925.987349:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770130688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788929925.987594:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770130688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929925.987871:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770130688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788929925.988949:0:11184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788929925.989013:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788929925.989034:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788929925.989046:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c9cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929925.989057:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c9cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929925.989067:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788929925.989069:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2eb5357800 from 7 10000000:01000000:1.0:1788929925.989072:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:2.0:1788929925.989207:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00010000:00010000:1.0:1788929925.989380:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929925.989389:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929925.989401:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929925.989424:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5b48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770130816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788929925.989476:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929925.991833:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9010db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788929925.991949:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770130816 00000100:00100000:3.0:1788929925.991960:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770130816 00000100:00100000:3.0:1788929925.992010:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788929925.992019:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770130816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929925.992034:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929925.992051:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237c9db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c9d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.992077:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237c9db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c9d4 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.992088:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237c9db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c9d4 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.992096:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596000, rc 0) 00000100:00100000:3.0:1788929925.992168:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770130816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (2691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929925.992175:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788929925.992356:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5b48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770130816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929925.992375:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c9db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.992383:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c9db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929925.992446:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770130944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929925.992487:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929925.992513:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d81085240 going to sleep for 11 seconds 00000100:00100000:3.0:1788929925.992525:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770130944 00000100:00100000:3.0:1788929925.992528:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770130944 00000100:00100000:3.0:1788929925.992544:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788929925.992549:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770130944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929925.993003:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770130944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 452us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929925.993010:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788929925.993039:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770130944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929925.993066:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770131072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929925.993167:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929925.993185:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d81085240 going to sleep for 11 seconds 00000100:00100000:3.0:1788929925.993197:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770131072 00000100:00100000:3.0:1788929925.993200:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770131072 00000100:00100000:3.0:1788929925.993219:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788929925.993334:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770131072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929925.993470:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770131072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929925.993476:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788929925.993584:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770131072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788929925.994467:0:11185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788929925.994537:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788929925.994553:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788929925.994561:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c9db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.994580:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c9db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788929925.994590:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788929925.994593:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2e86b99000 from 7 10000000:01000000:3.0:1788929925.994595:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788929925.994806:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.994814:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.994824:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929925.994842:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770131200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788929925.994956:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929925.994978:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d81085600 going to sleep for 11 seconds 00000100:00100000:3.0:1788929925.994996:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770131200 00000100:00100000:3.0:1788929925.995001:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770131200 00000100:00100000:3.0:1788929925.995027:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788929925.995035:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770131200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929925.995046:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929925.995057:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596400/0xce4472dd2237c9e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237c9e2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.995076:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596400/0xce4472dd2237c9e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237c9e2 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.995098:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596400/0xce4472dd2237c9e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c9e2 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.995397:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596400, rc 0) 00000100:00100000:3.0:1788929925.995437:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770131200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 403us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929925.995443:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788929925.995483:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770131200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929925.995578:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c9e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929925.995589:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c9e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929925.995709:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770131328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929925.995735:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929925.995759:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d81085600 going to sleep for 11 seconds 00000100:00100000:3.0:1788929925.995773:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770131328 00000100:00100000:3.0:1788929925.995777:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770131328 00000100:00100000:3.0:1788929925.995796:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788929925.995802:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770131328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929925.996441:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770131328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 637us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929925.996448:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788929925.996591:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770131328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788929925.996700:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86211880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770131456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788929925.996742:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929925.996775:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d66540 going to sleep for 11 seconds 00000100:00100000:3.0:1788929925.996825:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770131456 00000100:00100000:3.0:1788929925.996830:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770131456 00000100:00100000:3.0:1788929925.996943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788929925.996952:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770131456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929925.997091:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770131456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929925.997098:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788929925.999077:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86211880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770131456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788929926.003938:0:11186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788929926.004348:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788929926.004373:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788929926.004385:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c9e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929926.004413:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c9e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929926.426861:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929926.426937:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747025536 00000100:00100000:3.0:1788929926.426947:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747025536 00000100:00100000:3.0:1788929926.427005:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 239 00000100:00100000:3.0:1788929926.427015:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+11:5602:x1875828747025536:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929926.427034:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929926.427054:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237c9f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca7164021015e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929926.427081:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237c9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021015e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929926.427093:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237c9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021015e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929926.427112:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597c00, rc 0) 00000100:00100000:3.0:1788929926.427169:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+12:5602:x1875828747025536:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 155us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929926.427177:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 239 00000100:00100000:1.0:1788929926.430918:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929926.430990:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747025664 00000100:00100000:2.0:1788929926.431002:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747025664 00000100:00100000:2.0:1788929926.431057:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 240 00000100:00100000:2.0:1788929926.431068:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+12:5602:x1875828747025664:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788929926.431433:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+12:5602:x1875828747025664:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 365us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929926.431441:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 240 00000100:00100000:3.0:1788929926.441447:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929926.441674:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747025792 00000100:00100000:0.0:1788929926.441686:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747025792 00000100:00100000:0.0:1788929926.441756:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 241 00000100:00100000:0.0:1788929926.441767:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+12:5602:x1875828747025792:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788929926.442007:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+12:5602:x1875828747025792:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 241us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929926.442016:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 241 00000100:00100000:1.0:1788929926.476872:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929926.476978:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747025920 00000100:00100000:2.0:1788929926.476988:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747025920 00000100:00100000:2.0:1788929926.477101:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 242 00000100:00100000:2.0:1788929926.477112:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+12:5602:x1875828747025920:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788929926.477138:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929926.477157:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5340400/0xce4472dd2237c9f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca71640210165 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929926.477187:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5340400/0xce4472dd2237c9f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210165 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929926.477198:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5340400/0xce4472dd2237c9f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210165 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929926.477207:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340400, rc 0) 00000100:00100000:2.0:1788929926.477298:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:5602:x1875828747025920:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 188us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929926.477305:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 242 00000100:00100000:1.0:1788929926.483957:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929926.488059:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747026048 00000100:00100000:2.0:1788929926.488076:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747026048 00000100:00100000:2.0:1788929926.488287:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 243 00000100:00100000:2.0:1788929926.488299:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:5602:x1875828747026048:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788929926.488607:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:5602:x1875828747026048:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 309us (4658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929926.488616:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 243 00000100:00100000:1.0:1788929926.492848:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929926.503778:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747026176 00000100:00100000:0.0:1788929926.503794:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747026176 00000100:00100000:0.0:1788929926.503861:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 244 00000100:00100000:0.0:1788929926.503871:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:5602:x1875828747026176:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788929926.504196:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:5602:x1875828747026176:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 325us (11358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929926.504205:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 244 00010000:00010000:0.0:1788929926.561210:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929927.131571:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770131712:0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.131651:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929927.131715:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770132224:0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.131740:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929927.131770:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788929927.131777:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770131584:0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.131815:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929927.131838:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770132096:0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.131859:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929927.131884:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770131840:0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.131906:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929927.131925:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788929927.131930:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770131968:0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.131951:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929927.131981:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770131712 00000100:00100000:3.0:1788929927.131988:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770131712 00000100:00100000:3.0:1788929927.132028:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770132096 00000100:00100000:3.0:1788929927.132031:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770132096 00000100:00100000:3.0:1788929927.132055:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770131840 00000100:00100000:3.0:1788929927.132058:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770131840 00000100:00100000:3.0:1788929927.132077:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788929927.132086:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770131712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.132135:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770131712:12345-0@lo:400:kworker.0 Request processed in 50us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929927.132142:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788929927.132160:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788929927.132166:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770132096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.132203:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770132096:12345-0@lo:400:kworker.0 Request processed in 37us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929927.132209:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788929927.132221:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788929927.132254:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770131840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.132286:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770131840:12345-0@lo:400:kworker.0 Request processed in 34us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929927.132292:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788929927.132310:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770132224 00000100:00100000:3.0:1788929927.132314:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770132224 00000100:00100000:3.0:1788929927.132337:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770131968 00000100:00100000:3.0:1788929927.132340:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770131968 00000100:00100000:3.0:1788929927.132361:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788929927.132368:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770132224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.132396:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770132224:12345-0@lo:400:kworker.0 Request processed in 29us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929927.132402:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788929927.132412:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788929927.132418:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770131968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.132443:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770131968:12345-0@lo:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929927.132449:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788929927.132466:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770131584 00000100:00100000:3.0:1788929927.132469:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770131584 00000100:00100000:3.0:1788929927.132492:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788929927.132499:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770131584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.132537:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770131584:12345-0@lo:400:kworker.0 Request processed in 38us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929927.132543:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788929927.132579:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788929927.132583:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788929927.132586:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788929927.132619:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb5a3f800 x1875828770131968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929927.132633:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770131968:0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.132644:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770131840:0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.132675:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770131584:0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.132684:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770132096:0@lo:400:kworker.0 00000100:00100000:3.0:1788929927.132692:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770131712:0@lo:400:kworker.0 00010000:00080000:3.0:1788929927.132701:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb5a3d880 x1875828770132224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929927.132710:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770132224:0@lo:400:kworker.0 00010000:00010000:1.0:1788929927.583340:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929927.651924:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770132352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788929927.652017:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929927.652275:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770132352 00000100:00100000:2.0:1788929927.652283:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770132352 00000100:00100000:2.0:1788929927.652330:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788929927.652338:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770132352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788929927.652379:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929927.652425:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770132352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929927.652432:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788929927.652473:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e86211880 x1875828770132352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929927.652489:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770132352:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788929928.281088:0:11357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788929928.603456:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929929.180046:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788929929.180072:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770132480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788929929.180148:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929929.180814:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770132480 00000100:00100000:1.0:1788929929.180825:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770132480 00000100:00100000:1.0:1788929929.180896:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788929929.180906:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770132480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788929929.180954:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929929.181011:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770132480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929929.181018:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788929929.181733:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788929929.181770:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb5b49880 x1875828770132480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788929929.181798:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770132480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788929929.636141:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929929.690981:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929929.691039:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929929.691302:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747026560 00000100:00100000:0.0:1788929929.691313:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747026560 00000100:00100000:0.0:1788929929.691396:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 97 00000100:00100000:1.0:1788929929.691403:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929929.691412:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747026560:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929929.691449:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747026432 00000100:00100000:1.0:1788929929.691455:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747026432 00000100:00100000:1.0:1788929929.691491:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 98 00000100:00100000:1.0:1788929929.691500:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747026432:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788929929.691510:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747026560:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 103us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929929.691519:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 97 00000100:00100000:1.0:1788929929.691536:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747026432:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 35us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929929.691543:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 98 00000100:00080000:0.0:1788929929.691547:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788929929.692138:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747026304 00000100:00100000:3.0:1788929929.692145:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747026304 00000100:00100000:3.0:1788929929.692196:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 246 00000100:00100000:3.0:1788929929.692206:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747026304:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929929.692269:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747026304:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 64us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929929.692277:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 246 00010000:00010000:1.0:1788929930.654990:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788929931.642749:0:11456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:58:49 (1788929929) === 00010000:00010000:1.0:1788929931.681643:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929931.892474:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929931.892526:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929931.893727:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747026688 00000100:00100000:3.0:1788929931.893737:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747026688 00000100:00100000:3.0:1788929931.893797:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:3.0:1788929931.893809:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747026688:12345-192.168.204.40@tcp:41:mkdir.0 00000100:00100000:2.0:1788929931.894112:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747026816 00000100:00100000:2.0:1788929931.894117:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747026816 00000100:00100000:2.0:1788929931.894162:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:2.0:1788929931.894169:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:9687:x1875828747026816:12345-192.168.204.40@tcp:700:mkdir.0 00000100:00100000:2.0:1788929931.894273:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:9687:x1875828747026816:12345-192.168.204.40@tcp:700:mkdir.0 Request processed in 104us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929931.894281:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00080000:2.0:1788929931.898289:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788929931.898675:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788929931.899259:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747026688:12345-192.168.204.40@tcp:41:mkdir.0 Request processed in 5448us (6797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929931.899272:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:1.0:1788929931.899613:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929931.900209:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747027072 00000100:00100000:3.0:1788929931.900219:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747027072 00000100:00100000:3.0:1788929931.900412:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:3.0:1788929931.900424:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:9687:x1875828747027072:12345-192.168.204.40@tcp:36:mkdir.0 00010000:00010000:3.0:1788929931.900588:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929931.900647:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237c8df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100e7 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.900664:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4900) 00010000:00010000:3.0:1788929931.900689:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788929931.901315:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237c9fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.901331:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237c9fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.901342:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237c9fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.901356:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237ca05 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.901365:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237ca05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.901372:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237ca05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929931.906215:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788929931.906251:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237c9fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.906262:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237c9fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.906269:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237c9fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.906275:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929931.906280:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237c9fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.906298:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237c9fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.906315:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4f00) 00010000:00010000:3.0:1788929931.906318:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929931.906323:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237c9fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.906329:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237c9fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788929931.906349:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddd051db reply state 000000002cfe8cb6 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237ca05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929931.906358:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788929931.906453:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:9687:x1875828747027072:12345-192.168.204.40@tcp:36:mkdir.0 Request processed in 6028us (6838us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788929931.906462:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 15 00010000:00010000:3.0:1788929931.911481:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237ca05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.911499:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237ca05 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.911507:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237ca05 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.911513:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929931.911518:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237ca05 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.911538:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237ca05 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.911556:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2e907e4600) 00010000:00010000:3.0:1788929931.911559:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929931.911565:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237ca05 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.911571:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237ca05 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929931.926699:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929931.930797:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747027200 00000100:00100000:1.0:1788929931.930815:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747027200 00000100:00100000:1.0:1788929931.930887:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:1.0:1788929931.930897:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:9688:x1875828747027200:12345-192.168.204.40@tcp:101:chmod.0 00010000:00010000:1.0:1788929931.930918:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929931.930943:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784200/0xce4472dd2237ca0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021016c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929931.931009:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929931.931023:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929931.931036:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929931.931070:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788929931.931074:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788929931.931110:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929931.931136:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784200/0xce4472dd2237ca0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021016c expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929931.931181:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021016c expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929931.931189:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:1.0:1788929931.931192:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788929931.931195:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99785600, rc 0) 00000100:00100000:1.0:1788929931.931274:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:9688:x1875828747027200:12345-192.168.204.40@tcp:101:chmod.0 Request processed in 378us (4585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929931.931282:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:2.0:1788929931.938774:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929931.939094:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747027456 00000100:00100000:0.0:1788929931.939104:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747027456 00000100:00100000:0.0:1788929931.939219:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:0.0:1788929931.939259:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:9688:x1875828747027456:12345-192.168.204.40@tcp:36:chmod.0 00010000:00010000:0.0:1788929931.939314:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929931.939342:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021016c expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929931.939362:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:0.0:1788929931.939374:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788929931.939398:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237ca1a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929931.939411:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237ca1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929931.939420:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237ca1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788929931.939887:0:11024:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c0a6a1c reply state 0000000011b2f34c transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237ca1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929931.939897:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788929931.939904:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788929931.940124:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:9688:x1875828747027456:12345-192.168.204.40@tcp:36:chmod.0 Request processed in 737us (1228us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788929931.940131:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 17 00010000:00010000:2.0:1788929931.946416:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237ca1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929931.946432:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237ca1a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929931.946440:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237ca1a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929931.946446:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e80030a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929931.946472:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237ca1a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929931.946480:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237ca1a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929931.946500:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:2.0:1788929931.946504:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788929931.946509:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237ca1a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929931.946515:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237ca1a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929931.983615:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929931.983864:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747027584 00000100:00100000:3.0:1788929931.983874:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747027584 00000100:00100000:3.0:1788929931.983939:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:3.0:1788929931.983949:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:9689:x1875828747027584:12345-192.168.204.40@tcp:101:chown.0 00010000:00010000:3.0:1788929931.983972:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929931.983993:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237ca21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210173 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.984069:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237ca28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.984083:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237ca28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.984094:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237ca28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929931.984127:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788929931.984155:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788929931.984193:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237ca28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.984220:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237ca21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210173 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.984413:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237ca28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210173 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.984421:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:3.0:1788929931.984423:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788929931.984427:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597400, rc 0) 00000100:00100000:2.0:1788929931.984607:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:9689:x1875828747027584:12345-192.168.204.40@tcp:101:chown.0 Request processed in 657us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929931.984614:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:1.0:1788929931.987547:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929931.987704:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747027712 00000100:00100000:3.0:1788929931.987716:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747027712 00000100:00100000:3.0:1788929931.987782:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:3.0:1788929931.987793:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:9689:x1875828747027712:12345-192.168.204.40@tcp:101:chown.0 00010000:00010000:3.0:1788929931.987824:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929931.987844:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237ca2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021017a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.987907:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237ca36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.987920:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237ca36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.987942:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237ca36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.987973:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597a00/0xce4472dd2237ca3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.987980:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597a00/0xce4472dd2237ca3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.987986:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597a00/0xce4472dd2237ca3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988071:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ca44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988078:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ca44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988085:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ca44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929931.988114:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788929931.988117:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788929931.988133:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ca44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988157:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237ca36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988163:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237ca36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988170:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237ca36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988185:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929931.988190:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237ca36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988198:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237ca36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988210:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:3.0:1788929931.988212:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929931.988217:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237ca36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988248:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237ca36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988261:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597a00/0xce4472dd2237ca3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988267:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597a00/0xce4472dd2237ca3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988273:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597a00/0xce4472dd2237ca3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988277:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929931.988279:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597a00/0xce4472dd2237ca3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988284:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597a00/0xce4472dd2237ca3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988299:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2e907e4f00) 00010000:00010000:3.0:1788929931.988301:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929931.988304:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597a00/0xce4472dd2237ca3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988310:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597a00/0xce4472dd2237ca3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988336:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237ca2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021017a expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988347:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ca44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021017a expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929931.988353:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2e907e4900) 00010000:00010000:3.0:1788929931.988355:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788929931.988357:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596800, rc 0) 00000100:00100000:3.0:1788929931.988417:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:9689:x1875828747027712:12345-192.168.204.40@tcp:101:chown.0 Request processed in 626us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929931.988423:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:3.0:1788929931.992398:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929931.992590:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747027968 00000100:00100000:2.0:1788929931.992607:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747027968 00000100:00100000:2.0:1788929931.992666:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:2.0:1788929931.992676:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:9689:x1875828747027968:12345-192.168.204.40@tcp:36:chown.0 00010000:00010000:2.0:1788929931.992729:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929931.992757:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ca44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021017a expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929931.992774:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2e907e4900) 00010000:00010000:2.0:1788929931.992785:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788929931.992820:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ca4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929931.992844:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ca4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929931.992854:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ca4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788929932.042966:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1788929932.042981:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788929932.043458:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a532da7 reply state 00000000f529b6dc transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ca4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929932.043471:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788929932.043486:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1788929932.043736:0:5839:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788929932.043759:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:9689:x1875828747027968:12345-192.168.204.40@tcp:36:chown.0 Request processed in 51081us (51367us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788929932.043781:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 20 00010000:00010000:0.0:1788929932.043875:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ca4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.043885:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ca4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.043893:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ca4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.043899:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929932.043903:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ca4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.043912:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ca4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.043934:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2e98756200) 00010000:00010000:0.0:1788929932.043937:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788929932.043942:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ca4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.043960:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ca4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929932.063670:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929932.064364:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747028096 00000100:00100000:1.0:1788929932.064377:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747028096 00000100:00100000:1.0:1788929932.064427:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:1.0:1788929932.064436:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:9690:x1875828747028096:12345-192.168.204.40@tcp:101:touch.500 00010000:00010000:1.0:1788929932.064462:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929932.064492:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784200/0xce4472dd2237ca52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210181 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788929932.066349:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1794us 00010000:00010000:1.0:1788929932.095546:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.095577:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.095594:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.095622:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.095629:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.095636:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.095970:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237ca67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.095980:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237ca67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.095987:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237ca67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929932.096010:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788929932.096013:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788929932.096050:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237ca67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096061:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096068:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096075:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096092:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929932.096096:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096104:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096116:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:1.0:1788929932.096119:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929932.096123:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096129:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096141:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096158:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096164:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096169:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929932.096172:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096178:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096194:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2eb85fd200) 00010000:00010000:1.0:1788929932.096196:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929932.096199:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096205:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096266:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784200/0xce4472dd2237ca52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210181 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096280:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237ca67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210181 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.096286:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2eb85fda00) 00010000:00010000:1.0:1788929932.096289:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788929932.096291:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99785400, rc 0) 00000100:00100000:1.0:1788929932.096371:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:9690:x1875828747028096:12345-192.168.204.40@tcp:101:touch.500 Request processed in 31934us (32708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929932.096380:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:2.0:1788929932.112624:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929932.112771:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747028352 00000100:00100000:1.0:1788929932.112783:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747028352 00000100:00100000:1.0:1788929932.113198:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00100000:1.0:1788929932.113211:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86da8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:9690:x1875828747028352:12345-192.168.204.40@tcp:101:touch.500 00010000:00010000:1.0:1788929932.113314:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929932.113338:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784200/0xce4472dd2237ca6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210188 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.114697:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.114717:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.114728:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.114769:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.114776:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.114783:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788929932.122631:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788929932.123806:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ca83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.123828:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ca83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.123853:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ca83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.123895:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.123915:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca75 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.123922:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.123928:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929932.123933:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.123942:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.123955:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2eb85fda00) 00010000:00010000:1.0:1788929932.123958:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929932.123963:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.123969:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237ca75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788929932.123984:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd290b35 reply state 00000000a2f1d7b1 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929932.123994:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788929932.124036:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784200/0xce4472dd2237ca6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210188 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.124052:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ca83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210188 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.124070:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:1.0:1788929932.124072:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788929932.124074:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152c00, rc 0) 00000100:00100000:1.0:1788929932.124163:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86da8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:9690:x1875828747028352:12345-192.168.204.40@tcp:101:touch.500 Request processed in 10954us (11549us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788929932.124172:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 22 00010000:00010000:3.0:1788929932.130455:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.130475:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.130483:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.130489:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929932.130496:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.130504:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.130523:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff8d2eb85fd200) 00010000:00010000:3.0:1788929932.130527:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929932.130532:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.130538:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237ca7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929932.132031:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929932.132408:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747028608 00000100:00100000:0.0:1788929932.132421:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747028608 00000100:00100000:0.0:1788929932.132488:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:0.0:1788929932.132505:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:9690:x1875828747028608:12345-192.168.204.40@tcp:36:touch.500 00010000:00010000:0.0:1788929932.132580:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929932.132609:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ca83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210188 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.132627:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:0.0:1788929932.132638:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788929932.132686:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237ca91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.132701:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237ca91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.132710:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237ca91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788929932.132850:0:11024:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5535943 reply state 00000000c6b95e4f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237ca91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929932.132859:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788929932.132980:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:9690:x1875828747028608:12345-192.168.204.40@tcp:36:touch.500 Request processed in 483us (959us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788929932.132988:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:0.0:1788929932.139600:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929932.139657:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747028736 00000100:00100000:3.0:1788929932.139672:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747028736 00000100:00100000:3.0:1788929932.139728:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00100000:3.0:1788929932.139757:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:9690:x1875828747028736:12345-192.168.204.40@tcp:101:touch.500 00010000:00010000:3.0:1788929932.139783:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929932.139795:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237ca91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.139803:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237ca98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021018f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929932.139807:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237ca91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929932.139824:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237ca91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929932.139831:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e80031600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929932.139836:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237ca91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929932.139845:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237ca91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929932.139866:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:2.0:1788929932.139869:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929932.139875:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237ca91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929932.139881:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237ca91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.139888:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237ca98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021018f expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.139912:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237ca98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021018f expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.139934:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:3.0:1788929932.139937:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788929932.139940:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597600, rc 0) 00000100:00100000:3.0:1788929932.140170:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:9690:x1875828747028736:12345-192.168.204.40@tcp:101:touch.500 Request processed in 414us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929932.140178:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00100000:3.0:1788929932.151082:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929932.153173:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747028864 00000100:00100000:0.0:1788929932.153188:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747028864 00000100:00100000:0.0:1788929932.153299:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:0.0:1788929932.153308:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875828747028864:12345-192.168.204.40@tcp:8:touch.500 00010000:00080000:0.0:1788929932.153344:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:0.0:1788929932.153381:0:6687:0:(genops.c:1384:class_connect()) connect: client 668b9f78-1e26-4a12-8f20-ad475b3553ba, cookie 0xce4472dd2237ca9f 00002000:00100000:0.0:1788929932.153393:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 668b9f78-1e26-4a12-8f20-ad475b3553ba/ffff8d2eb544c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788929932.153420:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788929932.158377:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788929932.158422:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d2d8482d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788929932.158514:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2358:x1875828747028864:12345-192.168.204.40@tcp:8:touch.500 Request processed in 5204us (7441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929932.158525:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:2.0:1788929932.172482:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929932.172797:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747028992 00000100:00100000:3.0:1788929932.172806:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747028992 00000100:00100000:3.0:1788929932.172895:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:3.0:1788929932.172907:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86dab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:0:x1875828747028992:12345-192.168.204.40@tcp:2:touch.500 00000100:00080000:2.0:1788929932.174135:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788929932.251660:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770132736:0@lo:400:kworker.0 00000100:00100000:1.0:1788929932.251728:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929932.251787:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770133248:0@lo:400:kworker.0 00000100:00100000:1.0:1788929932.251814:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929932.251846:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788929932.251853:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770132608:0@lo:400:kworker.0 00000100:00100000:1.0:1788929932.251880:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929932.251904:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770133120:0@lo:400:kworker.0 00000100:00100000:1.0:1788929932.251929:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929932.251963:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770132864:0@lo:400:kworker.0 00000100:00100000:2.0:1788929932.251965:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770132736 00000100:00100000:2.0:1788929932.251975:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770132736 00000100:00100000:1.0:1788929932.252003:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929932.253304:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770133120 00000100:00100000:1.0:1788929932.253318:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788929932.253329:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770132992:0@lo:400:kworker.0 00000100:00100000:1.0:1788929932.253366:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929932.253405:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770132864 00000100:00100000:1.0:1788929932.253410:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770132864 00000100:00100000:1.0:1788929932.253454:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788929932.253464:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770132736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929932.253549:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770133120 00000100:00100000:1.0:1788929932.253555:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770132736:12345-0@lo:400:kworker.0 Request processed in 92us (1826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929932.253564:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788929932.253582:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788929932.253590:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770132864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929932.253632:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770132864:12345-0@lo:400:kworker.0 Request processed in 43us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929932.253639:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788929932.253651:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788929932.253659:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770133120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929932.253678:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770133248 00000100:00100000:0.0:1788929932.253684:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770133248 00000100:00100000:2.0:1788929932.253688:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770133120:12345-0@lo:400:kworker.0 Request processed in 30us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929932.253695:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788929932.253721:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770132992 00000100:00100000:0.0:1788929932.253725:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770132992 00000100:00100000:0.0:1788929932.253746:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788929932.253753:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770133248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929932.253792:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770133248:12345-0@lo:400:kworker.0 Request processed in 39us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929932.253798:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788929932.253813:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788929932.253819:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770132992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929932.253850:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770132992:12345-0@lo:400:kworker.0 Request processed in 31us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929932.253857:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788929932.253974:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770132608 00000100:00100000:1.0:1788929932.253979:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770132608 00000100:00100000:1.0:1788929932.254017:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788929932.254024:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770132608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929932.254058:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770132608:12345-0@lo:400:kworker.0 Request processed in 34us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929932.254064:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:1.0:1788929932.254093:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788929932.254098:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788929932.254101:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929932.254129:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770132608:0@lo:400:kworker.0 00000100:00100000:1.0:1788929932.254156:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770133120:0@lo:400:kworker.0 00000100:00100000:1.0:1788929932.254168:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770132736:0@lo:400:kworker.0 00010000:00080000:1.0:1788929932.254181:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8870c000 x1875828770133248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929932.254192:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770133248:0@lo:400:kworker.0 00010000:00080000:1.0:1788929932.254263:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e8870c700 x1875828770132992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929932.254273:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770132992:0@lo:400:kworker.0 00000100:00100000:1.0:1788929932.254283:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770132864:0@lo:400:kworker.0 00000001:00100000:2.0:1788929932.269654:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 668b9f78-1e26-4a12-8f20-ad475b3553ba 00000001:00080000:2.0:1788929932.269674:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1788929932.271580:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86dab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:0:x1875828747028992:12345-192.168.204.40@tcp:2:touch.500 Request processed in 98665us (99098us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788929932.271601:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:0.0:1788929932.278113:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929932.279033:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747029248 00000100:00100000:1.0:1788929932.279045:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747029248 00000100:00100000:1.0:1788929932.279109:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:1.0:1788929932.279120:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:9690:x1875828747029248:12345-192.168.204.40@tcp:35:touch.500 00000100:00100000:1.0:1788929932.279524:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+11:9690:x1875828747029248:12345-192.168.204.40@tcp:35:touch.500 Request processed in 405us (1423us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788929932.279532:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:2.0:1788929932.308433:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929932.308559:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747029376 00000100:00100000:0.0:1788929932.308572:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747029376 00000100:00100000:0.0:1788929932.309704:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:0.0:1788929932.309721:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+11:9691:x1875828747029376:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:0.0:1788929932.309748:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929932.309771:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237caa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210196 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.309857:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237caad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.309872:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237caad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.309883:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237caad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929932.309917:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788929932.309921:0:11024:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929932.309958:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237caad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.310085:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237caa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210196 expref: 13 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.310107:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237caad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210196 expref: 12 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.310118:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2eb85fda00) 00010000:00010000:0.0:1788929932.310121:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788929932.310127:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e80030a00, rc 0) 00000100:00100000:0.0:1788929932.310209:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+12:9691:x1875828747029376:12345-192.168.204.40@tcp:101:rm.0 Request processed in 493us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929932.310246:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:2.0:1788929932.324811:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929932.324905:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747029632 00000100:00100000:1.0:1788929932.324916:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747029632 00000100:00100000:1.0:1788929932.324998:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 26 00000100:00100000:1.0:1788929932.325010:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+12:9691:x1875828747029632:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:1.0:1788929932.325034:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929932.325058:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021019d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929932.325166:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788929932.325391:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cab4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021019d expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.325409:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:1.0:1788929932.325412:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788929932.325419:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021019d expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.325434:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152e00, rc 0) 00000100:00100000:1.0:1788929932.325493:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:9691:x1875828747029632:12345-192.168.204.40@tcp:101:rm.0 Request processed in 485us (692us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788929932.325506:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 26 00000100:00100000:2.0:1788929932.352310:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929932.352420:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747029760 00000100:00100000:1.0:1788929932.352431:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747029760 00000100:00100000:1.0:1788929932.352478:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:1.0:1788929932.352487:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:9691:x1875828747029760:12345-192.168.204.40@tcp:37:rm.0 00000100:00100000:0.0:1788929932.376812:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:9691:x1875828747029760:12345-192.168.204.40@tcp:37:rm.0 Request processed in 24308us (24498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929932.376828:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:2.0:1788929932.385938:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929932.386298:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747030016 00000100:00100000:0.0:1788929932.386314:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747030016 00000100:00100000:0.0:1788929932.386382:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:0.0:1788929932.386394:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90957850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:9691:x1875828747030016:12345-192.168.204.40@tcp:35:rm.0 00000100:00100000:0.0:1788929932.386934:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90957850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:9691:x1875828747030016:12345-192.168.204.40@tcp:35:rm.0 Request processed in 540us (1010us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788929932.386943:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:2.0:1788929932.391811:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929932.391912:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747030272 00000100:00100000:1.0:1788929932.391923:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747030272 00000100:00100000:1.0:1788929932.391996:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 27 00000100:00100000:1.0:1788929932.392006:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:9691:x1875828747030272:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:1.0:1788929932.392030:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929932.392050:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cac2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402101a4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.392173:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237cac9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.392189:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237cac9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.392204:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237cac9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929932.392219:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788929932.392412:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cac2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101a4 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.392434:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237cac9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101a4 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.392468:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2eb85fda00) 00010000:00010000:1.0:1788929932.392471:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788929932.392475:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152600, rc 0) 00000100:00100000:1.0:1788929932.392987:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:9691:x1875828747030272:12345-192.168.204.40@tcp:101:rm.0 Request processed in 972us (1189us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788929932.392996:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 27 00000100:00100000:2.0:1788929932.409602:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929932.410071:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747030400 00000100:00100000:3.0:1788929932.410101:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747030400 00000100:00100000:3.0:1788929932.410191:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 28 00000100:00100000:3.0:1788929932.410204:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:9691:x1875828747030400:12345-192.168.204.40@tcp:41:rm.0 00000004:00000024:1.0:1788929932.410993:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788929932.411076:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:9691:x1875828747030400:12345-192.168.204.40@tcp:41:rm.0 Request processed in 873us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929932.411088:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 28 00000100:00100000:2.0:1788929932.424395:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929932.425114:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747030528 00000100:00100000:1.0:1788929932.425130:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747030528 00000100:00100000:1.0:1788929932.425215:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 29 00000100:00100000:1.0:1788929932.425279:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:9691:x1875828747030528:12345-192.168.204.40@tcp:101:rm.0 00010000:00010000:1.0:1788929932.425304:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929932.425326:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cad7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402101ab expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.425397:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cade lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.425414:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.425426:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.425460:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cae5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.425468:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.425475:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427050:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237caec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427071:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237caec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427081:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237caec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929932.427126:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788929932.427130:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788929932.427166:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237caec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427179:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237caec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427189:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427196:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cade lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427250:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cade lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427258:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929932.427263:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cade lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427271:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cade lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427285:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2eb85fda00) 00010000:00010000:1.0:1788929932.427289:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929932.427295:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cade lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427302:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cade lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427318:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427324:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cae5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427330:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427335:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929932.427337:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427355:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cae5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427362:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff8d2eb85fd900) 00010000:00010000:1.0:1788929932.427364:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929932.427367:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cae5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427372:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cae5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427415:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cad7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ab expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427429:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237caec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ab expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.427436:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:1.0:1788929932.427439:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788929932.427441:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153800, rc 0) 00000100:00100000:1.0:1788929932.427921:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+17:9691:x1875828747030528:12345-192.168.204.40@tcp:101:rm.0 Request processed in 2317us (3157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929932.427931:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 29 00000100:00100000:2.0:1788929932.438622:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929932.438682:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747030784 00000100:00100000:0.0:1788929932.438694:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747030784 00000100:00100000:0.0:1788929932.438758:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 30 00000100:00100000:0.0:1788929932.438770:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+17:9691:x1875828747030784:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:0.0:1788929932.438818:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788929932.438843:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237caec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ab expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.438865:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237ca98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021018f expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.438875:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:0.0:1788929932.438892:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237caad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210196 expref: 15 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.438918:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2eb85fda00) 00010000:00010000:0.0:1788929932.438921:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788929932.438941:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237caf3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.438954:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237caf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.438962:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237caf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.438976:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cafa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.438994:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cafa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.439000:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cafa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.439129:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53200/0xce4472dd2237cb01 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.439150:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53200/0xce4472dd2237cb01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.439158:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53200/0xce4472dd2237cb01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788929932.439951:0:11024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788929932.439963:0:11024:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 317595738375ns, next at 318595735123ns, rc = 0 00010000:00010000:0.0:1788929932.440028:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53800/0xce4472dd2237cb08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440044:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53800/0xce4472dd2237cb08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440053:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53800/0xce4472dd2237cb08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440060:0:11024:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53800/0xce4472dd2237cb08 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440065:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53800/0xce4472dd2237cb08 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440071:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53800/0xce4472dd2237cb08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440098:0:11024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788929932.440115:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53200/0xce4472dd2237cb01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440122:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53200/0xce4472dd2237cb01 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440128:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53200/0xce4472dd2237cb01 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440133:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ea3c53200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929932.440148:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53200/0xce4472dd2237cb01 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440155:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53200/0xce4472dd2237cb01 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440171:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2e83038e00) 00010000:00010000:0.0:1788929932.440174:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788929932.440178:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53200/0xce4472dd2237cb01 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440184:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53200/0xce4472dd2237cb01 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440203:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237caf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440208:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237caf3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440213:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237caf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440218:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e80031e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929932.440242:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237caf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440249:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237caf3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929932.440253:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788929932.440256:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2eb85fda00) 00010000:00010000:0.0:1788929932.440258:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929932.440260:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53800/0xce4472dd2237cb08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.440261:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237caf3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929932.440267:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ea3c53800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788929932.440268:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237caf3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929932.440270:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53800/0xce4472dd2237cb08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929932.440276:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53800/0xce4472dd2237cb08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929932.440285:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2e83038e00) 00010000:00010000:2.0:1788929932.440287:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000004:00010000:0.0:1788929932.440288:0:11024:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000976023d5 reply state 00000000052e7679 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cafa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929932.440290:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53800/0xce4472dd2237cb08 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929932.440296:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53800/0xce4472dd2237cb08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929932.440298:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788929932.440310:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929932.440311:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929932.440313:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929932.440389:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:9691:x1875828747030784:12345-192.168.204.40@tcp:36:rm.0 Request processed in 1619us (1775us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788929932.440397:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 30 00000100:00100000:2.0:1788929932.451778:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929932.451864:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747031040 00000100:00100000:0.0:1788929932.451873:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747031040 00000100:00100000:0.0:1788929932.451930:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:0.0:1788929932.451940:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:9691:x1875828747031040:12345-192.168.204.40@tcp:35:rm.0 00000100:00100000:0.0:1788929932.452197:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+17:9691:x1875828747031040:12345-192.168.204.40@tcp:35:rm.0 Request processed in 257us (428us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788929932.452206:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00010000:00010000:3.0:1788929932.453429:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cafa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.453445:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cafa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.453455:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cafa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.453462:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e80031600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929932.453467:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cafa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.453475:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cafa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.453492:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff8d2e83038900) 00010000:00010000:3.0:1788929932.453496:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929932.453501:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cafa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929932.453508:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cafa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929932.466727:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929932.466827:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747031296 00000100:00100000:1.0:1788929932.466838:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747031296 00000100:00100000:1.0:1788929932.466900:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 31 00000100:00100000:1.0:1788929932.466911:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:9691:x1875828747031296:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:1.0:1788929932.466971:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788929932.467023:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237cac9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101a4 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.467047:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237ca67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210181 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.467062:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2eb85fda00) 00010000:00010000:1.0:1788929932.467080:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237ca28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210173 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.467089:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:1.0:1788929932.467095:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788929932.467119:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cb0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.467132:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cb0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.467156:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cb0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.467170:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cb16 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.467177:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cb16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.467184:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cb16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.467494:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cb1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.467507:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cb1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.467514:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cb1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929932.468044:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788929932.468061:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cb1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.468069:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cb1d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.468076:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cb1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.468082:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929932.468086:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cb1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.468094:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cb1d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.468104:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2eb85fd200) 00010000:00010000:1.0:1788929932.468107:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788929932.468110:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cb1d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.468117:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237cb1d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.468134:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cb0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.468162:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cb0f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.468168:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cb0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.468173:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929932.468176:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cb0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.468182:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cb0f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.468190:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:1.0:1788929932.468192:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929932.468196:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cb0f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.468201:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cb0f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788929932.468213:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005948b52f reply state 00000000af577931 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cb16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929932.468251:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788929932.468323:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:9691:x1875828747031296:12345-192.168.204.40@tcp:36:rm.0 Request processed in 1412us (1605us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788929932.468331:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 31 00010000:00010000:0.0:1788929932.472068:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cb16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.472087:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cb16 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.472096:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cb16 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.472103:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929932.472108:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cb16 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.472118:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cb16 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.472160:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2eb85fdc00) 00010000:00010000:0.0:1788929932.472163:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929932.472168:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cb16 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929932.472175:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cb16 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929932.699409:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929932.766183:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770133376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788929932.766349:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929932.767071:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770133376 00000100:00100000:2.0:1788929932.767085:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770133376 00000100:00100000:2.0:1788929932.767175:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788929932.767186:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770133376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788929932.767252:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929932.767312:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770133376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929932.767318:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788929932.770327:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d86daad80 x1875828770133376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929932.770358:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770133376:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788929933.723457:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788929934.303487:0:6714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319459260320ns, next at 320459258245ns, rc = 0 00000100:00100000:2.0:1788929934.303508:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788929934.303527:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770133504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788929934.303593:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929934.303659:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770133504 00000100:00100000:2.0:1788929934.303666:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770133504 00000100:00100000:2.0:1788929934.303735:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788929934.303744:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770133504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788929934.303792:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929934.303842:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770133504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929934.303849:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788929934.303870:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788929934.304156:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d86da9f80 x1875828770133504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929934.304176:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770133504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788929934.748874:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929934.811188:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929934.811237:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929934.811267:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929934.811292:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929934.811330:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747031552 00000100:00100000:3.0:1788929934.811340:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747031552 00000100:00100000:3.0:1788929934.811398:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747031808 00000100:00100000:3.0:1788929934.811402:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747031808 00000100:00100000:3.0:1788929934.811425:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 102 00000100:00100000:3.0:1788929934.811435:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:2359:x1875828747031552:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929934.811505:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:2359:x1875828747031552:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 72us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929934.811513:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 102 00000100:00100000:3.0:1788929934.811528:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 103 00000100:00100000:3.0:1788929934.811534:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2359:x1875828747031808:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929934.813820:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747031680 00000100:00100000:2.0:1788929934.813831:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747031680 00000100:00100000:2.0:1788929934.814150:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 59 00000100:00100000:2.0:1788929934.814161:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2359:x1875828747031680:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929934.814627:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2359:x1875828747031808:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 3091us (3404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929934.814637:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 103 00000100:00080000:3.0:1788929934.814663:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788929934.814667:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929934.818312:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747031424 00000100:00100000:0.0:1788929934.818329:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747031424 00000100:00100000:0.0:1788929934.818392:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 248 00000100:00100000:0.0:1788929934.818484:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2359:x1875828747031424:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929934.828136:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2359:x1875828747031680:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 13966us (16831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929934.828151:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 59 00000100:00100000:0.0:1788929934.833867:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2359:x1875828747031424:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 15455us (22588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929934.833881:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 248 00010000:00010000:1.0:1788929935.778452:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929936.796376:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929937.373080:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770133632:0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.373165:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929937.373218:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770134144:0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.373263:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929937.373296:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788929937.373302:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770133760:0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.373322:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929937.373338:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770134272:0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.373359:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929937.373396:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770133888:0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.373437:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929937.373457:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929937.373462:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770134016:0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.373482:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929937.373656:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770133632 00000100:00100000:0.0:1788929937.373665:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770133632 00000100:00100000:0.0:1788929937.373708:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788929937.373717:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770133632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.373769:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770133632:12345-0@lo:400:kworker.0 Request processed in 52us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929937.373776:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788929937.373806:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770134144 00000100:00100000:0.0:1788929937.373809:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770134144 00000100:00100000:0.0:1788929937.373841:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770133760 00000100:00100000:0.0:1788929937.373844:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770133760 00000100:00100000:0.0:1788929937.373854:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770133888 00000100:00100000:0.0:1788929937.373856:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770133888 00000100:00100000:0.0:1788929937.373868:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788929937.373874:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770134144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.373905:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770134144:12345-0@lo:400:kworker.0 Request processed in 31us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929937.373910:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788929937.373920:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788929937.373925:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770133760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.373947:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770133760:12345-0@lo:400:kworker.0 Request processed in 22us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929937.373952:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788929937.373972:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788929937.373977:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770133888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.374010:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770133888:12345-0@lo:400:kworker.0 Request processed in 32us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929937.374016:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788929937.374037:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770134272 00000100:00100000:0.0:1788929937.374040:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770134272 00000100:00100000:0.0:1788929937.374074:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770134016 00000100:00100000:0.0:1788929937.374077:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770134016 00000100:00100000:0.0:1788929937.374103:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788929937.374109:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770134272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.374140:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770134272:12345-0@lo:400:kworker.0 Request processed in 31us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929937.374146:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788929937.374157:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788929937.374162:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770134016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.374185:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770134016:12345-0@lo:400:kworker.0 Request processed in 23us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929937.374191:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788929937.374205:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788929937.374209:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788929937.374212:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788929937.374256:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebc4c2300 x1875828770134016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929937.374269:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770134016:0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.374280:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770133888:0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.374319:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770133760:0@lo:400:kworker.0 00010000:00080000:0.0:1788929937.374328:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebc4c1f80 x1875828770134272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929937.374336:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770134272:0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.374344:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770133632:0@lo:400:kworker.0 00000100:00100000:0.0:1788929937.374351:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770134144:0@lo:400:kworker.0 00000001:00080000:0.0:1788929937.491989:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1788929937.492006:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788929937.492037:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788929937.492059:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1788929937.494422:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788929937.494445:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770134400:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788929937.494524:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929937.494616:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770134400 00000100:00100000:2.0:1788929937.494623:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770134400 00000100:00100000:2.0:1788929937.494680:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788929937.494688:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86daad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770134400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788929937.494713:0:6989:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788929937.494760:0:6989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa0e78b, atime: 0x6aa0e78b, ctime: 0x6aa0e78b, blocks: 0x1 00010000:00010000:2.0:1788929937.494768:0:6989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008810e4b5/0xce4472dd2237cb24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929937.494782:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1788929937.494798:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929937.494805:0:6989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008810e4b5/0xce4472dd2237cb24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929937.494821:0:6989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008810e4b5/0xce4472dd2237cb24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929937.494830:0:6989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008810e4b5/0xce4472dd2237cb24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929937.494838:0:6989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008810e4b5/0xce4472dd2237cb24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929937.494873:0:6989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788929937.495584:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86daad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875828770134400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 893us (1056us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788929937.495598:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1788929937.495632:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788929937.495645:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008810e4b5/0xce4472dd2237cb24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929937.495655:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788929937.495660:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008810e4b5/0xce4472dd2237cb24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929937.495687:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008810e4b5/0xce4472dd2237cb24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929937.495705:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008810e4b5/0xce4472dd2237cb24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929937.495713:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008810e4b5/0xce4472dd2237cb24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929937.495735:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929937.495737:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929937.495739:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788929937.495795:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2d86da9f80/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788929937.495807:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770134400:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788929937.835082:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929937.894202:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788929937.894247:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770134528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788929937.894336:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929937.894403:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770134528 00000100:00100000:2.0:1788929937.894412:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770134528 00000100:00100000:2.0:1788929937.894460:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788929937.894469:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770134528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788929937.894511:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929937.894567:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770134528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929937.894573:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788929937.894621:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d86daa300 x1875828770134528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929937.894640:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770134528:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788929937.953129:0:11609:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788929938.846006:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929939.419600:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788929939.419627:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770134656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788929939.419700:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929939.419876:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770134656 00000100:00100000:2.0:1788929939.419885:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770134656 00000100:00080000:0.0:1788929939.419951:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788929939.420030:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788929939.420042:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875828770134656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788929939.420077:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929939.420196:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875828770134656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929939.420204:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788929939.420339:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770134656:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788929939.650668:0:11657:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefce30ae0 20000000:00000080:2.0:1788929939.650687:0:11657:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2eb5973400 uarg=0000000000000000 20000000:01000000:2.0:1788929939.650723:0:11657:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788929939.650729:0:11657:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788929939.650734:0:11657:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788929939.655917:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788929939.663081:0:11657:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788929939.671740:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788929939.672094:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788929939.672171:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788929939.672189:0:11657:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788929939.672211:0:11657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.672257:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2eb5341c00/0xce4472dd2237c9cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c9c6 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.672266:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237c9db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c9d4 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.672273:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ebc596400/0xce4472dd2237c9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237c9e2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.672283:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237c9f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021015e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.672289:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2eb5340400/0xce4472dd2237c9f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210165 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.672296:0:11657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.672355:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2eb5340400/0xce4472dd2237c9f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210165 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.672369:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2eb5340400/0xce4472dd2237c9f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210165 expref: 12 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929939.672400:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86daa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875828770134784:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788929939.672548:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237c9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021015e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.672557:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237c9f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021015e expref: 12 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929939.672566:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875828770134912:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788929939.672602:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ebc596400/0xce4472dd2237c9e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c9e2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.672611:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ebc596400/0xce4472dd2237c9e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c9e2 expref: 18 pid: 5831 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929939.672620:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875828770135040:0@lo:104: 00000100:00100000:2.0:1788929939.672665:0:11657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788929939.672712:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237c9db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c9d4 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.672720:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237c9db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c9d4 expref: 18 pid: 5831 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929939.673014:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770135040 00000100:00100000:1.0:1788929939.673022:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770135040 00000100:00100000:1.0:1788929939.673069:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788929939.673090:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:11657:x1875828770135040:12345-0@lo:104: 00010000:00010000:1.0:1788929939.673103:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c9e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.673163:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788929939.673169:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:11657:x1875828770135040:12345-0@lo:104: Request processed in 93us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929939.673176:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1788929939.673209:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788929939.673214:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c9e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.673238:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597800 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788929939.673243:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c9e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.673251:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c9e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788929939.673259:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c9e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929939.673265:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788929939.673292:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c9e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.673298:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788929939.673320:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c9e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.673327:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597800/0xce4472dd2237c9e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c9e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.673339:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929939.673341:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929939.673343:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929939.673366:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770135296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788929939.673398:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929939.673441:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770135296 00000100:00100000:1.0:1788929939.673452:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770135296 00010000:00010000:1.0:1788929939.673471:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ebc596400/0xce4472dd2237c9e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c9e2 expref: 19 pid: 5831 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929939.673504:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788929939.673511:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88162300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770135296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788929939.673576:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929939.673582:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ebc596400/0xce4472dd2237c9e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c9e2 expref: 19 pid: 5831 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929939.675395:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875828770135168:0@lo:104: 00000100:00100000:2.0:1788929939.675735:0:11657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929939.675761:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770135168 00000100:00100000:3.0:1788929939.675770:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770135168 00000100:00100000:3.0:1788929939.675818:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788929939.675829:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:11657:x1875828770135168:12345-0@lo:104: 00010000:00010000:3.0:1788929939.675844:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c9db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929939.675893:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788929939.675899:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:11657:x1875828770135168:12345-0@lo:104: Request processed in 74us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929939.675906:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788929939.675937:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788929939.675944:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c9db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929939.675953:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784400 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:3.0:1788929939.675958:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c9db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929939.675967:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c9db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788929939.675974:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c9db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788929939.675980:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788929939.676026:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c9db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929939.676032:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788929939.676053:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c9db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929939.676061:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99784400/0xce4472dd2237c9d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c9db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929939.676075:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929939.676077:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929939.676079:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929939.676103:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770135424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788929939.676132:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929939.676169:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770135424 00000100:00100000:3.0:1788929939.676179:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770135424 00010000:00010000:3.0:1788929939.676196:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237c9db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c9d4 expref: 20 pid: 5831 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929939.676218:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788929939.676247:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+20:3310:x1875828770135424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788929939.676257:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929939.676263:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237c9db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c9d4 expref: 20 pid: 5831 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.690624:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ebc596400/0xce4472dd2237c9e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c9e2 expref: 20 pid: 5831 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.690667:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929939.690799:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88162300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+20:3309:x1875828770135296:12345-0@lo:103:ldlm_bl.0 Request processed in 17286us (17398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929939.690809:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788929939.690920:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770135296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788929939.695883:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929939.695924:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929939.695952:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747031936 00000100:00100000:1.0:1788929939.695962:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747031936 00010000:00010000:1.0:1788929939.696014:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2eb5340400/0xce4472dd2237c9f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210165 expref: 13 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929939.696044:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747032064 00000100:00100000:1.0:1788929939.696047:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747032064 00010000:00010000:1.0:1788929939.696060:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237c9f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021015e expref: 14 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929939.696095:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 32 00000100:00100000:1.0:1788929939.696106:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32bd5a92-c2e2-4642-929e-29df1e036b64+14:2362:x1875828747031936:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929939.696132:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929939.696138:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2eb5340400/0xce4472dd2237c9f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210165 expref: 14 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.696151:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2eb5340400/0xce4472dd2237c9f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210165 expref: 14 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.696171:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929939.696240:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32bd5a92-c2e2-4642-929e-29df1e036b64+14:2362:x1875828747031936:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 116us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929939.696249:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 32 00000100:00100000:1.0:1788929939.696267:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 33 00000100:00100000:1.0:1788929939.696274:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88162680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747032064:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929939.696281:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929939.696285:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237c9f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021015e expref: 13 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.696296:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237c9f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021015e expref: 13 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.696305:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929939.696323:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88162680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747032064:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 50us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929939.696330:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 33 00010000:00010000:3.0:1788929939.701273:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237c9db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c9d4 expref: 19 pid: 5831 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.710148:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2eb5341c00/0xce4472dd2237c9cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237c9c6 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.710170:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2eb5341c00/0xce4472dd2237c9cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237c9c6 expref: 19 pid: 5833 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929939.710207:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875828770135552:0@lo:104: 00000100:00100000:2.0:1788929939.710937:0:11657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788929939.711873:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929939.712025:0:11657:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e88011600 going to sleep for 11 seconds 00010000:00010000:2.0:1788929939.712059:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5340400/0xce4472dd2237c9f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210165 expref: 12 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929939.712076:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86daa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875828770134784:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788929939.712093:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237c9f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021015e expref: 11 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929939.712102:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875828770134912:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788929939.712114:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc596400/0xce4472dd2237c9e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c9e2 expref: 19 pid: 5831 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929939.712121:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875828770135040:0@lo:104: 00010000:00010000:2.0:1788929939.712130:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237c9db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c9d4 expref: 18 pid: 5831 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929939.712138:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875828770135168:0@lo:104: 00000100:00100000:2.0:1788929939.712388:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:3310:x1875828770135424:12345-0@lo:103:ldlm_bl.0 Request processed in 36162us (36254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929939.712398:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788929939.712465:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770135424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788929939.718737:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788929939.718769:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770135552 00000100:00100000:0.0:1788929939.718780:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770135552 00000100:00100000:0.0:1788929939.718949:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788929939.718960:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:11657:x1875828770135552:12345-0@lo:104: 00010000:00010000:0.0:1788929939.718979:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c9cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929939.719086:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788929939.719093:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+3:11657:x1875828770135552:12345-0@lo:104: Request processed in 136us (8158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929939.719117:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788929939.719204:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788929939.719212:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237c9cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.719219:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597000 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788929939.719238:0:7628:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237c9cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.719247:0:7628:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237c9cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788929939.719255:0:7628:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237c9cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788929939.719260:0:7628:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788929939.719296:0:7628:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c9cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.719303:0:7628:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788929939.719321:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c9cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.719328:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597000/0xce4472dd2237c9c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237c9cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.719345:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929939.719347:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929939.719349:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929939.719404:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875828770135552:0@lo:104: 00010000:00010000:1.0:1788929939.719440:0:11657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929939.720177:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770135680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788929939.720245:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929939.722060:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770135680 00000100:00100000:1.0:1788929939.722076:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770135680 00010000:00010000:1.0:1788929939.722123:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2eb5341c00/0xce4472dd2237c9cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c9c6 expref: 17 pid: 5833 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929939.722154:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788929939.722162:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:3311:x1875828770135680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788929939.722177:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929939.722182:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2eb5341c00/0xce4472dd2237c9cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237c9c6 expref: 17 pid: 5833 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.722192:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2eb5341c00/0xce4472dd2237c9cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237c9c6 expref: 17 pid: 5833 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.722209:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5341c00/0xce4472dd2237c9cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237c9c6 expref: 17 pid: 5833 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.722244:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.722253:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.722271:0:7629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.722278:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.722284:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.722303:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.722310:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788929939.722314:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.722322:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.722341:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929939.722352:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929939.722425:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3311:x1875828770135680:12345-0@lo:103:ldlm_bl.0 Request processed in 263us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929939.722432:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1788929939.722571:0:11657:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.722581:0:11657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929939.722595:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237cb2b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929939.724969:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770135680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788929939.867354:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929939.929106:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929939.929140:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929939.929162:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929939.929187:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747032320 00000100:00100000:3.0:1788929939.929198:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747032320 00000100:00100000:3.0:1788929939.929271:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:3.0:1788929939.929281:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2361:x1875828747032320:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929939.929348:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2361:x1875828747032320:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 69us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929939.929355:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:2.0:1788929939.934296:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747032192 00000100:00100000:2.0:1788929939.934309:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747032192 00000100:00100000:2.0:1788929939.934365:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747032448 00000100:00100000:2.0:1788929939.934368:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747032448 00000100:00100000:2.0:1788929939.934397:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 107 00000100:00100000:2.0:1788929939.934406:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747032192:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929939.934490:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747032192:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 85us (5348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929939.934497:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 107 00000100:00100000:2.0:1788929939.934516:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 108 00000100:00100000:2.0:1788929939.934523:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747032448:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929939.934546:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747032448:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 24us (5384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929939.934552:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 108 00000100:00080000:3.0:1788929939.938338:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788929939.938348:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1788929940.699646:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788929940.699655:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2d85d86800 from 7 10000000:01000000:3.0:1788929940.699659:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788929940.699710:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.699722:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.699733:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929940.699757:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770135808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788929940.699827:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929940.699892:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788929940.700035:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770135808 00000100:00100000:0.0:1788929940.700044:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770135808 00000100:00100000:0.0:1788929940.700099:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788929940.700107:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:5837:x1875828770135808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788929940.700119:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929940.700133:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237cb39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237cb32 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929940.700153:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237cb39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237cb32 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929940.700163:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237cb39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237cb32 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929940.700171:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ea3c53800, rc 0) 00000100:00100000:0.0:1788929940.700246:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770135808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929940.700252:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788929940.700417:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770135808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929940.700430:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.700447:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929940.700611:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770135936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929940.700637:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929940.700721:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788929940.704156:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770135936 00000100:00100000:1.0:1788929940.704172:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770135936 00000100:00100000:1.0:1788929940.704998:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788929940.705012:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770135936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788929940.705345:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770135936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (4707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929940.705353:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788929940.705445:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770135936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929940.705506:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770136064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929940.705557:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929940.712355:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788929940.712622:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770136064 00000100:00100000:0.0:1788929940.712632:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770136064 00000100:00100000:0.0:1788929940.712682:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788929940.712692:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770136064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788929940.712925:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770136064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (7366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929940.712932:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788929940.714104:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770136064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788929940.715132:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:11671:1875828770136192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788929940.715207:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929940.715261:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886c2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788929940.715449:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770136192 00000100:00100000:3.0:1788929940.715456:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770136192 00000100:00100000:3.0:1788929940.715498:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788929940.715508:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:11671:x1875828770136192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788929940.715705:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:11671:x1875828770136192:12345-0@lo:502:llog_process_th.0 Request processed in 197us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929940.715713:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788929940.717770:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:11671:1875828770136192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788929940.717813:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788929940.717824:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788929940.717827:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788929940.717834:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2d85d86800 00000020:00000080:0.0:1788929940.717837:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788929940.717936:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:11671:1875828770136320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788929940.718016:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929940.718049:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886c2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788929940.722919:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770136320 00000100:00100000:3.0:1788929940.722934:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770136320 00000100:00100000:3.0:1788929940.728397:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788929940.728422:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:11671:x1875828770136320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788929940.728688:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:11671:x1875828770136320:12345-0@lo:502:llog_process_th.0 Request processed in 277us (10671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929940.728695:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788929940.728755:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:11671:1875828770136320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788929940.728787:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788929940.728793:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788929940.728796:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788929940.728800:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788929940.728916:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788929940.728933:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788929940.728942:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.728974:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788929940.728993:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788929940.728995:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2eb5357800 from 7 10000000:01000000:3.0:1788929940.728998:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788929940.729026:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.729034:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.729044:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929940.729061:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770136448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788929940.733205:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929940.733264:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788929940.733293:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770136448 00000100:00100000:3.0:1788929940.733300:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770136448 00000100:00100000:3.0:1788929940.733340:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788929940.733350:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:5837:x1875828770136448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929940.733365:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929940.733385:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596200/0xce4472dd2237cb47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237cb40 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.733411:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596200/0xce4472dd2237cb47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237cb40 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.734137:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596200/0xce4472dd2237cb47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237cb40 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.734257:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596200, rc 0) 00000100:00100000:3.0:1788929940.734307:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770136448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 958us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929940.734315:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788929940.734372:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770136448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929940.734390:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.734400:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929940.734679:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770136576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929940.734708:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929940.734740:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788929940.735056:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770136576 00000100:00100000:2.0:1788929940.735062:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770136576 00000100:00100000:2.0:1788929940.735327:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788929940.735337:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770136576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788929940.735889:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86316c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770136576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 554us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929940.735896:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788929940.737909:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770136576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929940.737991:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770136704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929940.738055:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929940.738304:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788929940.740079:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770136704 00000100:00100000:2.0:1788929940.740094:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770136704 00000100:00100000:2.0:1788929940.740158:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788929940.740168:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770136704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788929940.740825:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86316450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770136704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 655us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929940.740834:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788929940.740931:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770136704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929940.741816:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:11674:1875828770136832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788929940.741864:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929940.741906:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788929940.741949:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770136832 00000100:00100000:2.0:1788929940.741962:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770136832 00000100:00100000:2.0:1788929940.742000:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788929940.742007:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:11674:x1875828770136832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929940.742405:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86315050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:11674:x1875828770136832:12345-0@lo:502:llog_process_th.0 Request processed in 397us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929940.742414:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788929940.742514:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:11674:1875828770136832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788929940.742535:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788929940.742544:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788929940.742547:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788929940.742553:0:11674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2eb5357800 00000020:00000080:0.0:1788929940.742556:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788929940.742634:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:11674:1875828770136960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788929940.742668:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929940.742686:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886c26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929940.742811:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770136960 00000100:00100000:3.0:1788929940.742816:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770136960 00000100:00100000:3.0:1788929940.742853:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788929940.742860:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:11674:x1875828770136960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788929940.742999:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86315c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:11674:x1875828770136960:12345-0@lo:502:llog_process_th.0 Request processed in 139us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929940.743006:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788929940.743843:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:11674:1875828770136960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788929940.743868:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788929940.743874:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788929940.743876:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788929940.743880:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788929940.744405:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788929940.744423:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788929940.744443:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.744455:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788929940.744465:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788929940.744468:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2e86b99000 from 7 10000000:01000000:3.0:1788929940.744472:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788929940.744641:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.744650:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.744659:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929940.744678:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770137088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788929940.744719:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929940.744758:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929940.744773:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770137088 00000100:00100000:3.0:1788929940.744779:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770137088 00000100:00100000:3.0:1788929940.744807:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788929940.744815:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:5837:x1875828770137088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929940.744826:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929940.744837:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc597000/0xce4472dd2237cb55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237cb4e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.744857:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc597000/0xce4472dd2237cb55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237cb4e expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.744868:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc597000/0xce4472dd2237cb55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237cb4e expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.744876:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597000, rc 0) 00000100:00100000:3.0:1788929940.744909:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770137088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929940.744916:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788929940.744948:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770137088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788929940.744959:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929940.744969:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929940.745021:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770137216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929940.745044:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929940.745096:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929940.745109:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770137216 00000100:00100000:3.0:1788929940.745112:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770137216 00000100:00100000:3.0:1788929940.745134:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788929940.745140:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770137216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788929940.752844:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86315450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770137216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7695us (7790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929940.752858:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788929940.754456:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770137216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788929940.754532:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770137344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788929940.754595:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929940.754628:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e88011900 going to sleep for 11 seconds 00000100:00100000:3.0:1788929940.754827:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770137344 00000100:00100000:3.0:1788929940.754835:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770137344 00000100:00100000:3.0:1788929940.754882:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788929940.754890:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770137344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788929940.755096:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86316850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:5837:x1875828770137344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929940.755103:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788929940.755542:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bddba76f-ee04-4b28-985b-cc9b0811bff7:5837:1875828770137344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788929940.761703:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:11675:1875828770137472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929940.761795:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929940.761841:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e88011a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788929940.762013:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770137472 00000100:00100000:0.0:1788929940.762021:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770137472 00000100:00100000:0.0:1788929940.762070:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788929940.762081:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:11675:x1875828770137472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788929940.762346:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:11675:x1875828770137472:12345-0@lo:502:llog_process_th.0 Request processed in 266us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929940.762354:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788929940.762922:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:11675:1875828770137472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788929940.762951:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788929940.762960:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788929940.762962:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788929940.762973:0:11675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2e86b99000 00000020:00000080:2.0:1788929940.762976:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788929940.763070:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:11675:1875828770137600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929940.763106:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929940.763129:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770137600 00000100:00100000:2.0:1788929940.763133:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770137600 00000100:00100000:0.0:1788929940.763368:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929940.763392:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747032576 00000100:00100000:0.0:1788929940.763395:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747032576 00000100:00100000:0.0:1788929940.763446:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 264 00000100:00100000:0.0:1788929940.763455:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+11:5602:x1875828747032576:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788929940.763467:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929940.763486:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237cb5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca716402101b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929940.763759:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788929940.763766:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:11675:x1875828770137600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788929940.763926:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:11675:x1875828770137600:12345-0@lo:502:llog_process_th.0 Request processed in 160us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929940.763933:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788929940.763973:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e88011a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788929940.763996:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bddba76f-ee04-4b28-985b-cc9b0811bff7:11675:1875828770137600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788929940.764016:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788929940.764021:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788929940.764023:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788929940.764027:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00010000:00010000:0.0:1788929940.764211:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237cb5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101b2 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929940.764389:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237cb5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101b2 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929940.764399:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ea3c53200, rc 0) 00000100:00100000:0.0:1788929940.765590:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+12:5602:x1875828747032576:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 2130us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929940.765599:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 264 00000020:01000000:0.0:1788929940.765650:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788929940.765682:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788929940.765690:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929940.765700:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788929940.770655:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788929940.771339:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929940.783064:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747032704 00000100:00100000:3.0:1788929940.783079:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747032704 00000100:00100000:3.0:1788929940.783344:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 266 00000100:00100000:3.0:1788929940.783356:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+12:5602:x1875828747032704:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788929940.785825:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+12:5602:x1875828747032704:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 2461us (14479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929940.785838:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 266 00000100:00100000:3.0:1788929940.788634:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929940.813066:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747032832 00000100:00100000:1.0:1788929940.813080:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747032832 00000100:00100000:2.0:1788929940.827812:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 267 00000100:00100000:2.0:1788929940.827827:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+12:5602:x1875828747032832:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788929940.828067:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+12:5602:x1875828747032832:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 243us (39444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929940.828075:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 267 00000100:00100000:3.0:1788929940.846263:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929940.846374:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747032960 00000100:00100000:2.0:1788929940.846405:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747032960 00000100:00100000:2.0:1788929940.846464:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 268 00000100:00100000:2.0:1788929940.846474:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+12:9961:x1875828747032960:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788929940.846711:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+12:9961:x1875828747032960:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 238us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929940.846719:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 268 00000100:00100000:3.0:1788929940.852737:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929940.852923:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747033088 00000100:00100000:0.0:1788929940.852934:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747033088 00000100:00100000:0.0:1788929940.852999:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 269 00000100:00100000:0.0:1788929940.853010:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+12:9961:x1875828747033088:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788929940.853406:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+12:9961:x1875828747033088:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 396us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929940.853415:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 269 00000100:00100000:3.0:1788929940.858134:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929940.858204:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747033216 00000100:00100000:0.0:1788929940.858214:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747033216 00000100:00100000:0.0:1788929940.858314:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 270 00000100:00100000:0.0:1788929940.858324:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+12:5602:x1875828747033216:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788929940.858342:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929940.858359:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ea3c52800/0xce4472dd2237cb63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca716402101b9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929940.858389:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ea3c52800/0xce4472dd2237cb63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101b9 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929940.858401:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ea3c52800/0xce4472dd2237cb63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101b9 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929940.858435:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ea3c52800, rc 0) 00000100:00100000:0.0:1788929940.858484:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:5602:x1875828747033216:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 161us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929940.858491:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 270 00000100:00100000:3.0:1788929940.863637:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929940.865327:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747033344 00000100:00100000:1.0:1788929940.865357:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747033344 00000100:00100000:1.0:1788929940.865427:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 271 00000100:00100000:1.0:1788929940.865448:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:5602:x1875828747033344:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788929940.865742:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:5602:x1875828747033344:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 296us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929940.865750:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 271 00000100:00100000:3.0:1788929940.869187:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929940.870940:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747033472 00000100:00100000:1.0:1788929940.870954:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747033472 00000100:00100000:1.0:1788929940.871031:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 272 00000100:00100000:1.0:1788929940.871042:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:5602:x1875828747033472:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788929940.871305:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:5602:x1875828747033472:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 265us (2126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929940.871314:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 272 00000100:00100000:3.0:1788929940.880508:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929940.880668:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747033600 00000100:00100000:0.0:1788929940.880678:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747033600 00000100:00100000:0.0:1788929940.880721:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 273 00000100:00100000:0.0:1788929940.880729:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:9963:x1875828747033600:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788929940.880989:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:9963:x1875828747033600:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 250us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929940.880997:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 273 00000100:00100000:3.0:1788929940.884209:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929940.884375:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747033728 00000100:00100000:1.0:1788929940.884387:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747033728 00000100:00100000:1.0:1788929940.884448:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 274 00000100:00100000:1.0:1788929940.884458:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:9963:x1875828747033728:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788929940.884695:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:9963:x1875828747033728:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 238us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929940.884704:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 274 00010000:00010000:3.0:1788929940.892135:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788929941.789551:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788929941.915829:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929942.494580:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770137984:0@lo:400:kworker.0 00000100:00100000:3.0:1788929942.494663:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929942.494727:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788929942.494734:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770138112:0@lo:400:kworker.0 00000100:00100000:3.0:1788929942.494759:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929942.494795:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770137984 00000100:00100000:3.0:1788929942.494803:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770137984 00000100:00100000:3.0:1788929942.494849:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788929942.494859:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770137984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929942.494919:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770137984:12345-0@lo:400:kworker.0 Request processed in 62us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929942.494926:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788929942.494964:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770138112 00000100:00100000:3.0:1788929942.494967:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770138112 00000100:00100000:3.0:1788929942.494992:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788929942.494999:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875828770138112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929942.495338:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875828770138112:12345-0@lo:400:kworker.0 Request processed in 338us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929942.495345:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788929942.495363:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788929942.495367:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929942.495812:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770137728:0@lo:400:kworker.0 00000100:00100000:1.0:1788929942.495847:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929942.495874:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770138240:0@lo:400:kworker.0 00000100:00100000:1.0:1788929942.495918:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929942.495939:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788929942.495944:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770137856:0@lo:400:kworker.0 00000100:00100000:1.0:1788929942.495975:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929942.495991:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770138368:0@lo:400:kworker.0 00000100:00100000:1.0:1788929942.496011:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929942.496037:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770138240 00000100:00100000:1.0:1788929942.496042:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770138240 00000100:00100000:1.0:1788929942.496075:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770137856 00000100:00100000:1.0:1788929942.496078:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770137856 00000100:00100000:1.0:1788929942.496096:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788929942.496103:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770138240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929942.496140:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770138240:12345-0@lo:400:kworker.0 Request processed in 38us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929942.496146:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788929942.496160:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788929942.496165:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770137856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929942.496189:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770137856:12345-0@lo:400:kworker.0 Request processed in 24us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929942.496193:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788929942.496212:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770138368 00000100:00100000:1.0:1788929942.496215:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770138368 00000100:00100000:1.0:1788929942.496265:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788929942.496271:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770138368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929942.496299:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770138368:12345-0@lo:400:kworker.0 Request processed in 28us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929942.496304:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788929942.496331:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788929942.496335:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929942.496362:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770137856:0@lo:400:kworker.0 00010000:00080000:1.0:1788929942.496374:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85552680 x1875828770138368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929942.496384:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770138368:0@lo:400:kworker.0 00000100:00100000:1.0:1788929942.496393:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770138240:0@lo:400:kworker.0 00000100:00100000:1.0:1788929942.496433:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770137728 00000100:00100000:1.0:1788929942.496436:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770137728 00000100:00100000:1.0:1788929942.496460:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788929942.496466:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770137728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929942.496501:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770137728:12345-0@lo:400:kworker.0 Request processed in 35us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929942.496507:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788929942.496542:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770137728:0@lo:400:kworker.0 00000100:00100000:1.0:1788929942.496586:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770138112:0@lo:400:kworker.0 00000100:00100000:1.0:1788929942.496596:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770137984:0@lo:400:kworker.0 00000001:00080000:2.0:1788929942.582021:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1788929942.939430:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929943.004498:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788929943.004519:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770138496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788929943.004582:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929943.004771:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770138496 00000100:00100000:2.0:1788929943.004778:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770138496 00000100:00100000:2.0:1788929943.004826:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788929943.004835:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770138496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788929943.004867:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929943.004924:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770138496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929943.004930:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788929943.005056:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb597c000 x1875828770138496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929943.005072:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770138496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788929943.963683:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929944.539892:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788929944.539928:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770138624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788929944.540049:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929944.540676:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770138624 00000100:00100000:2.0:1788929944.540688:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770138624 00000100:00080000:1.0:1788929944.541092:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788929944.541314:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788929944.541327:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770138624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788929944.541378:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929944.541460:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770138624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929944.541467:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788929944.541541:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788929944.541547:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2d86da9f80, transno 4294967300 00000100:00100000:1.0:1788929944.541580:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770138624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788929944.987718:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929945.060392:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929945.060439:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929945.060481:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929945.060535:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929945.060958:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747033984 00000100:00100000:1.0:1788929945.060970:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747033984 00000100:00100000:1.0:1788929945.061034:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747034240 00000100:00100000:1.0:1788929945.061037:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747034240 00000100:00100000:1.0:1788929945.061061:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 112 00000100:00100000:1.0:1788929945.061070:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2359:x1875828747033984:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929945.061145:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2359:x1875828747033984:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 76us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929945.061154:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 112 00000100:00100000:1.0:1788929945.061171:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 113 00000100:00100000:1.0:1788929945.061177:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2359:x1875828747034240:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929945.061202:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2359:x1875828747034240:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929945.061208:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 113 00000100:00080000:1.0:1788929945.061262:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929945.061311:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747034112 00000100:00100000:1.0:1788929945.061314:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747034112 00000100:00100000:1.0:1788929945.061362:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:1.0:1788929945.061369:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2359:x1875828747034112:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929945.061400:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2359:x1875828747034112:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 31us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929945.061410:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00080000:1.0:1788929945.061426:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788929945.061576:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747033856 00000100:00100000:2.0:1788929945.061595:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747033856 00000100:00100000:2.0:1788929945.061634:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 276 00000100:00100000:2.0:1788929945.061653:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2359:x1875828747033856:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929945.061682:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2359:x1875828747033856:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 31us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929945.061688:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 276 00010000:00010000:2.0:1788929946.013530:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929947.036333:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929947.612189:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770139136:0@lo:400:kworker.0 00000100:00100000:0.0:1788929947.612289:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929947.612472:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770138752:0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.612537:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929947.612573:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770139264:0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.612598:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929947.612624:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788929947.612631:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770138880:0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.612651:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929947.612667:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770139392:0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.612685:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929947.612717:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770139136 00000100:00100000:1.0:1788929947.612734:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770139136 00000100:00100000:1.0:1788929947.612790:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770139392 00000100:00100000:1.0:1788929947.612794:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770139392 00000100:00100000:1.0:1788929947.612818:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788929947.612826:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770139136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.612886:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770139136:12345-0@lo:400:kworker.0 Request processed in 60us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929947.612893:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788929947.612909:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788929947.612916:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770139392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.612946:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770139392:12345-0@lo:400:kworker.0 Request processed in 32us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929947.612953:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788929947.612970:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770138752 00000100:00100000:1.0:1788929947.612974:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770138752 00000100:00100000:1.0:1788929947.613011:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788929947.613024:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770138752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.613064:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770138752:12345-0@lo:400:kworker.0 Request processed in 47us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929947.613070:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788929947.613105:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770139264 00000100:00100000:1.0:1788929947.613109:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770139264 00000100:00100000:1.0:1788929947.613133:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770138880 00000100:00100000:1.0:1788929947.613136:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770138880 00000100:00100000:1.0:1788929947.613155:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788929947.613161:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770139264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.613192:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770139264:12345-0@lo:400:kworker.0 Request processed in 31us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929947.613198:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788929947.613209:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788929947.613215:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770138880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.613264:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770138880:12345-0@lo:400:kworker.0 Request processed in 49us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929947.613271:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788929947.613314:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770138880:0@lo:400:kworker.0 00010000:00080000:1.0:1788929947.613327:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb597ea00 x1875828770139392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929947.613337:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770139392:0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.613345:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770138752:0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.613353:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770139264:0@lo:400:kworker.0 00000100:00080000:1.0:1788929947.613381:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788929947.613391:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788929947.613393:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788929947.613519:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770139008:0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.613547:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929947.613574:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770139008 00000100:00100000:1.0:1788929947.613578:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770139008 00000100:00100000:1.0:1788929947.613606:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788929947.613612:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770139008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.613645:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770139008:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929947.613651:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1788929947.613667:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929947.613682:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770139008:0@lo:400:kworker.0 00000100:00100000:1.0:1788929947.613828:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770139136:0@lo:400:kworker.0 00010000:00010000:1.0:1788929948.060887:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929948.124049:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788929948.142554:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770139520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788929948.142632:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929948.143654:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770139520 00000100:00100000:3.0:1788929948.143664:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770139520 00000100:00100000:3.0:1788929948.143718:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788929948.143727:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770139520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788929948.143766:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929948.143831:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770139520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929948.143838:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788929948.145214:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb597d180 x1875828770139520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929948.145260:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770139520:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788929949.084296:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929949.660183:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788929949.660207:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770139648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788929949.660307:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929949.660546:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770139648 00000100:00100000:2.0:1788929949.660555:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770139648 00000100:00100000:2.0:1788929949.660625:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788929949.660645:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770139648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788929949.660681:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929949.660739:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770139648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929949.660747:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788929949.660947:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770139648:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788929949.661909:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788929950.107464:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929950.172592:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929950.172637:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929950.172663:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929950.172743:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929950.173817:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747034496 00000100:00100000:1.0:1788929950.173826:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747034496 00000100:00100000:1.0:1788929950.173877:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747034752 00000100:00100000:1.0:1788929950.173880:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747034752 00000100:00100000:0.0:1788929950.174429:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747034368 00000100:00100000:0.0:1788929950.174434:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747034368 00000100:00100000:0.0:1788929950.174470:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 278 00000100:00100000:0.0:1788929950.174481:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2361:x1875828747034368:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788929950.174555:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2361:x1875828747034368:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 77us (1973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929950.174563:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 278 00000100:00100000:1.0:1788929950.182840:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 117 00000100:00100000:1.0:1788929950.182877:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2361:x1875828747034496:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929950.183479:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2361:x1875828747034496:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 608us (10839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929950.183497:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 117 00000100:00100000:1.0:1788929950.183518:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 118 00000100:00100000:1.0:1788929950.183527:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747034752:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929950.183553:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747034752:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (10811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929950.183558:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 118 00000100:00100000:1.0:1788929950.183581:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747034624 00000100:00100000:1.0:1788929950.183589:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747034624 00000100:00100000:1.0:1788929950.183622:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:1.0:1788929950.183629:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2361:x1875828747034624:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929950.183667:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2361:x1875828747034624:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 37us (11002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929950.183673:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00080000:1.0:1788929950.183693:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788929950.183697:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788929951.007402:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788929951.132395:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929952.155869:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929952.732706:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770139904:0@lo:400:kworker.0 00000100:00100000:0.0:1788929952.732783:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929952.732836:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770140416:0@lo:400:kworker.0 00000100:00100000:0.0:1788929952.732878:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929952.732908:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788929952.732914:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770139776:0@lo:400:kworker.0 00000100:00100000:0.0:1788929952.732941:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929952.732958:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770140288:0@lo:400:kworker.0 00000100:00100000:0.0:1788929952.732977:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929952.733000:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770140032:0@lo:400:kworker.0 00000100:00100000:0.0:1788929952.733023:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929952.733038:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929952.733043:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770140160:0@lo:400:kworker.0 00000100:00100000:0.0:1788929952.733066:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929952.733095:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770140416 00000100:00100000:0.0:1788929952.733102:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770140416 00000100:00100000:0.0:1788929952.733145:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770140160 00000100:00100000:0.0:1788929952.733148:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770140160 00000100:00100000:0.0:1788929952.733188:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788929952.733197:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770140416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929952.733268:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770140416:12345-0@lo:400:kworker.0 Request processed in 73us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929952.733276:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788929952.733293:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788929952.733299:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770140160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929952.733331:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770140160:12345-0@lo:400:kworker.0 Request processed in 33us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929952.733337:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788929952.733368:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770140160:0@lo:400:kworker.0 00010000:00080000:0.0:1788929952.733394:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebc4c1f80 x1875828770140416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929952.733405:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770140416:0@lo:400:kworker.0 00000100:00100000:1.0:1788929952.733737:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770139904 00000100:00100000:1.0:1788929952.733743:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770139904 00000100:00100000:1.0:1788929952.733784:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770140288 00000100:00100000:1.0:1788929952.733787:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770140288 00000100:00100000:1.0:1788929952.733801:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770140032 00000100:00100000:1.0:1788929952.733804:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770140032 00000100:00100000:1.0:1788929952.733816:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788929952.733831:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770139904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929952.733885:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770139904:12345-0@lo:400:kworker.0 Request processed in 55us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929952.733892:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788929952.733905:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788929952.733911:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770140288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929952.733936:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770140288:12345-0@lo:400:kworker.0 Request processed in 25us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929952.733941:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788929952.733951:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788929952.733956:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770140032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929952.733982:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770140032:12345-0@lo:400:kworker.0 Request processed in 26us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929952.733988:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788929952.734006:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770139776 00000100:00100000:1.0:1788929952.734010:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770139776 00000100:00100000:1.0:1788929952.734034:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788929952.734040:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770139776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929952.734069:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770139776:12345-0@lo:400:kworker.0 Request processed in 29us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929952.734075:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:1.0:1788929952.734107:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788929952.734111:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788929952.734114:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788929952.734137:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770139776:0@lo:400:kworker.0 00000100:00100000:1.0:1788929952.734147:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770140288:0@lo:400:kworker.0 00000100:00100000:1.0:1788929952.734164:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770139904:0@lo:400:kworker.0 00000100:00100000:0.0:1788929952.735009:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770140032:0@lo:400:kworker.0 00010000:00010000:3.0:1788929953.179397:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929953.247293:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788929953.247314:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770140544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788929953.247383:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929953.247612:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770140544 00000100:00100000:2.0:1788929953.247620:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770140544 00000100:00100000:2.0:1788929953.247671:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788929953.247681:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770140544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788929953.247714:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929953.247774:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770140544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929953.247781:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788929953.248075:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb597ce00 x1875828770140544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788929953.248092:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770140544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788929954.206766:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929954.779782:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770140672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788929954.779853:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929954.779976:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770140672 00000100:00100000:2.0:1788929954.779985:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770140672 00000100:00100000:2.0:1788929954.780053:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788929954.780073:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770140672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788929954.780125:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929954.780181:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770140672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929954.780188:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788929954.781196:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788929954.781269:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770140672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788929955.227504:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929955.297456:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929955.297514:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929955.297605:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747035008 00000100:00100000:2.0:1788929955.297615:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747035008 00000100:00100000:2.0:1788929955.297698:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 122 00000100:00100000:2.0:1788929955.297721:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747035008:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929955.297802:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747035008:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 95us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929955.297819:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 122 00000100:00100000:0.0:1788929955.298305:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747034880 00000100:00100000:0.0:1788929955.298312:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747034880 00000100:00100000:0.0:1788929955.298350:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 280 00000100:00100000:0.0:1788929955.298358:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747034880:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788929955.298406:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747034880:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 49us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929955.298426:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 280 00000100:00080000:1.0:1788929955.298538:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929955.301032:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929955.301121:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747035264 00000100:00100000:2.0:1788929955.301130:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747035264 00000100:00100000:2.0:1788929955.301202:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 123 00000100:00100000:2.0:1788929955.301212:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2361:x1875828747035264:12345-192.168.204.40@tcp:400:kworker.0 00000100:00080000:1.0:1788929955.301361:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788929955.301635:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2361:x1875828747035264:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 424us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929955.301644:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 123 00000100:00100000:1.0:1788929955.308499:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929955.308543:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747035136 00000100:00100000:0.0:1788929955.308554:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747035136 00000100:00100000:0.0:1788929955.308625:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:0.0:1788929955.308635:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2358:x1875828747035136:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:0.0:1788929955.308669:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237ca9f 00000100:00080000:0.0:1788929955.308679:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d2d8482d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788929955.308733:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788929955.309010:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+2:2358:x1875828747035136:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 375us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929955.309019:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00080000:2.0:1788929955.309132:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788929955.311995:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929956.252749:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929957.275459:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929957.859592:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770140928:0@lo:400:kworker.0 00000100:00100000:0.0:1788929957.860875:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770141056:0@lo:400:kworker.0 00000100:00100000:3.0:1788929957.861150:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770140800:0@lo:400:kworker.0 00000100:00100000:2.0:1788929957.862329:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929957.863047:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929957.863121:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929957.863132:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770141184:0@lo:400:kworker.0 00000100:00100000:0.0:1788929957.863166:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929957.863341:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770140928 00000100:00100000:3.0:1788929957.863852:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929957.863961:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770140928 00000100:00100000:0.0:1788929957.864007:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770141056 00000100:00100000:0.0:1788929957.864010:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770141056 00000100:00100000:0.0:1788929957.864042:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788929957.864051:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770140928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929957.864096:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770141312:0@lo:400:kworker.0 00000100:00100000:0.0:1788929957.864112:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770140928:12345-0@lo:400:kworker.0 Request processed in 61us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929957.864120:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788929957.864133:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929957.864140:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770141312 00000100:00100000:0.0:1788929957.864153:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770141312 00000100:00100000:2.0:1788929957.864162:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770140928:0@lo:400:kworker.0 00000100:00100000:2.0:1788929957.864177:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770141440:0@lo:400:kworker.0 00000100:00100000:0.0:1788929957.864180:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788929957.864190:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770141056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929957.864260:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770141056:12345-0@lo:400:kworker.0 Request processed in 72us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929957.864267:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788929957.864283:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788929957.864290:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770141312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929957.864331:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929957.864331:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770141312:12345-0@lo:400:kworker.0 Request processed in 38us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929957.864412:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770141184 00000100:00100000:2.0:1788929957.864417:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770141184 00000100:00100000:2.0:1788929957.864451:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770141440 00000100:00100000:2.0:1788929957.864454:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770141440 00000100:00100000:2.0:1788929957.864474:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788929957.864481:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770141184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929957.864515:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770141184:12345-0@lo:400:kworker.0 Request processed in 35us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929957.864522:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788929957.864537:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788929957.864545:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770141440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929957.864575:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770141440:12345-0@lo:400:kworker.0 Request processed in 32us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929957.864581:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788929957.864607:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788929957.864612:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788929957.864616:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788929957.864648:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb597f100 x1875828770141440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929957.864673:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770141440:0@lo:400:kworker.0 00000100:00100000:2.0:1788929957.864717:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770140800 00000100:00100000:2.0:1788929957.864721:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770140800 00000100:00100000:2.0:1788929957.864749:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788929957.864758:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770140800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929957.864796:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770140800:12345-0@lo:400:kworker.0 Request processed in 40us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929957.864813:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788929957.864879:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770141184:0@lo:400:kworker.0 00000100:00100000:2.0:1788929957.864891:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770140800:0@lo:400:kworker.0 00000100:00100000:1.0:1788929957.864898:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770141056:0@lo:400:kworker.0 00000100:00100000:2.0:1788929957.864909:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770141312:0@lo:400:kworker.0 00000100:00100000:0.0:1788929957.874512:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000001:00100000:2.0:1788929957.904861:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 668b9f78-1e26-4a12-8f20-ad475b3553ba 00000020:00000080:2.0:1788929957.904872:0:6716:0:(genops.c:885:class_export_put()) final put ffff8d2eb544c800/668b9f78-1e26-4a12-8f20-ad475b3553ba 00000020:00000080:2.0:1788929957.904900:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb544c800/668b9f78-1e26-4a12-8f20-ad475b3553ba for lustre-OST0000 00000020:00000080:2.0:1788929957.904948:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d8482d800 for lustre-OST0000 00010000:00010000:1.0:1788929958.299507:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929958.365131:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788929958.365157:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770141568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788929958.365272:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929958.365471:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770141568 00000100:00100000:2.0:1788929958.365480:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770141568 00000100:00100000:2.0:1788929958.365535:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788929958.365545:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770141568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788929958.365579:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929958.365633:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770141568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929958.365640:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788929958.365741:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb597df80 x1875828770141568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929958.365770:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770141568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788929959.323942:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929959.899687:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770141696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788929959.899764:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929959.900136:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770141696 00000100:00100000:3.0:1788929959.900145:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770141696 00000100:00100000:3.0:1788929959.900426:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788929959.900440:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770141696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788929959.900479:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929959.900554:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770141696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929959.900561:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788929959.900613:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788929959.900664:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770141696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788929960.350790:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929960.409354:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929960.409397:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929960.409404:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747035392 00000100:00100000:2.0:1788929960.409417:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747035392 00000100:00100000:1.0:1788929960.409441:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929960.409471:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 282 00000100:00100000:2.0:1788929960.409481:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747035392:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929960.409590:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747035392:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 110us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929960.409598:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 282 00000100:00100000:3.0:1788929960.409691:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747035648 00000100:00100000:3.0:1788929960.409697:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747035648 00000100:00100000:3.0:1788929960.409746:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747035520 00000100:00100000:3.0:1788929960.409749:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747035520 00000100:00100000:3.0:1788929960.409774:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 127 00000100:00100000:3.0:1788929960.409782:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747035648:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929960.409826:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747035648:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 44us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929960.409833:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 127 00000100:00100000:3.0:1788929960.409847:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 128 00000100:00100000:3.0:1788929960.409854:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2360:x1875828747035520:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929960.409879:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2360:x1875828747035520:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 25us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929960.409885:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 128 00000100:00080000:2.0:1788929960.410350:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788929961.243944:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788929961.380332:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929962.395359:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929962.971664:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770141952:0@lo:400:kworker.0 00000100:00100000:0.0:1788929962.971715:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770142080:0@lo:400:kworker.0 00000100:00100000:1.0:1788929962.971739:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929962.971772:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770141952 00000100:00100000:0.0:1788929962.971780:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770141952 00000100:00100000:1.0:1788929962.971804:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9ae1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770142464:0@lo:400:kworker.0 00000100:00100000:0.0:1788929962.971827:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788929962.971835:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770141952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929962.971839:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929962.971865:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788929962.971870:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770141824:0@lo:400:kworker.0 00000100:00100000:0.0:1788929962.971886:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770141952:12345-0@lo:400:kworker.0 Request processed in 51us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929962.971893:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788929962.971894:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929962.971913:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9ae1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770142336:0@lo:400:kworker.0 00000100:00100000:0.0:1788929962.971924:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929962.971939:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770142464 00000100:00100000:1.0:1788929962.971943:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770142464 00000100:00100000:0.0:1788929962.971947:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929962.971951:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770142208:0@lo:400:kworker.0 00000100:00100000:0.0:1788929962.971971:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929962.971978:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770142208 00000100:00100000:1.0:1788929962.971981:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770142208 00000100:00100000:0.0:1788929962.971993:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770142080 00000100:00100000:0.0:1788929962.971997:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770142080 00000100:00100000:1.0:1788929962.972019:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788929962.972019:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788929962.972025:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770142464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929962.972025:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770142080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929962.972054:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770142464:12345-0@lo:400:kworker.0 Request processed in 29us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929962.972055:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770142080:12345-0@lo:400:kworker.0 Request processed in 31us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929962.972062:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788929962.972062:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788929962.972073:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788929962.972078:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770142208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929962.972101:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770142080:0@lo:400:kworker.0 00000100:00100000:1.0:1788929962.972104:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770142208:12345-0@lo:400:kworker.0 Request processed in 26us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929962.972109:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788929962.972119:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770142208:0@lo:400:kworker.0 00000100:00100000:1.0:1788929962.972125:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770141824 00000100:00100000:1.0:1788929962.972128:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770141824 00000100:00100000:0.0:1788929962.972132:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929962.972148:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788929962.972154:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770141824:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788929962.972154:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e9ae1d180 x1875828770142464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929962.972165:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9ae1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770142464:0@lo:400:kworker.0 00000100:00100000:0.0:1788929962.972174:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770141952:0@lo:400:kworker.0 00000100:00100000:1.0:1788929962.972180:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770141824:12345-0@lo:400:kworker.0 Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929962.972185:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788929962.972187:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770141824:0@lo:400:kworker.0 00000100:00100000:0.0:1788929962.972199:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770142336 00000100:00100000:0.0:1788929962.972201:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770142336 00000100:00100000:0.0:1788929962.972241:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788929962.972248:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770142336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929962.972294:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770142336:12345-0@lo:400:kworker.0 Request processed in 46us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929962.972309:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1788929962.972312:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788929962.972318:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788929962.972320:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788929962.972334:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9ae1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770142336:0@lo:400:kworker.0 00010000:00010000:2.0:1788929963.419585:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929963.483536:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788929963.483572:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770142592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788929963.483641:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929963.483828:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770142592 00000100:00100000:1.0:1788929963.483844:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770142592 00000100:00100000:1.0:1788929963.483908:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788929963.483917:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770142592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788929963.483957:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929963.484008:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770142592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929963.484015:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788929963.487258:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb597f100 x1875828770142592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929963.487297:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770142592:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788929964.449950:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788929964.999515:0:11840:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:59:21 (1788929961) 00000100:00100000:0.0:1788929965.025549:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770142720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788929965.025630:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929965.025858:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770142720 00000100:00100000:1.0:1788929965.025866:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770142720 00000100:00100000:1.0:1788929965.025924:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788929965.025934:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770142720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788929965.025982:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929965.026038:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770142720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929965.026045:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788929965.026173:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788929965.027339:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770142720:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788929965.471670:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929965.531295:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929965.531341:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929965.531373:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929965.531489:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747035776 00000100:00100000:2.0:1788929965.531499:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747035776 00000100:00100000:1.0:1788929965.531533:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747035904 00000100:00100000:1.0:1788929965.531539:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747035904 00000100:00100000:2.0:1788929965.531575:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 284 00000100:00100000:2.0:1788929965.531587:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747035776:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929965.531592:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747036032 00000100:00100000:1.0:1788929965.531597:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747036032 00000100:00100000:1.0:1788929965.531643:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 132 00000100:00100000:1.0:1788929965.531651:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2360:x1875828747035904:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929965.531668:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747035776:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 82us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929965.531677:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 284 00000100:00100000:1.0:1788929965.531694:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2360:x1875828747035904:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 43us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929965.531720:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 132 00000100:00100000:1.0:1788929965.531736:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 133 00000100:00100000:1.0:1788929965.531742:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747036032:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929965.531765:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747036032:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 23us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929965.531771:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 133 00000100:00080000:3.0:1788929965.532311:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788929966.491419:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929966.975569:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929966.975681:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747036160 00000100:00100000:0.0:1788929966.975691:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747036160 00000100:00100000:0.0:1788929966.975754:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 32 00000100:00100000:0.0:1788929966.975765:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:10233:x1875828747036160:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788929966.975787:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929966.975821:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53c00/0xce4472dd2237cb6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402101c0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.975889:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cb71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.975904:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cb71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.975917:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cb71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929966.976112:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788929966.976117:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929966.976158:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cb71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.976198:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ea3c53c00/0xce4472dd2237cb6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101c0 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.976219:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cb71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101c0 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.976288:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929966.976291:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788929966.976295:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e80031600, rc 0) 00000100:00100000:0.0:1788929966.976401:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:10233:x1875828747036160:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 638us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929966.976409:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 32 00000100:00100000:3.0:1788929966.983735:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929966.983909:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747036288 00000100:00100000:0.0:1788929966.983919:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747036288 00000100:00100000:0.0:1788929966.983996:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 33 00000100:00100000:0.0:1788929966.984005:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:10234:x1875828747036288:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788929966.984026:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929966.984047:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237cb78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402101c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984113:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237cb7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984126:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237cb7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984137:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237cb7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984171:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cb86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984178:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cb86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984185:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cb86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984557:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8a00/0xce4472dd2237cb8d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984566:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8a00/0xce4472dd2237cb8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984574:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8a00/0xce4472dd2237cb8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929966.984602:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788929966.984606:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929966.984624:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8a00/0xce4472dd2237cb8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984635:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237cb7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984642:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237cb7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984649:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237cb7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984665:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e80030a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929966.984670:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237cb7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984677:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237cb7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984689:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929966.984691:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929966.984696:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237cb7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984702:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80030a00/0xce4472dd2237cb7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984712:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cb86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984718:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cb86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984723:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cb86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984729:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929966.984732:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cb86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984738:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cb86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984755:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d2e83038a00) 00010000:00010000:0.0:1788929966.984758:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929966.984761:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cb86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984768:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cb86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984814:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031e00/0xce4472dd2237cb78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101c7 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984828:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8a00/0xce4472dd2237cb8d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101c7 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.984835:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2e83038e00) 00010000:00010000:0.0:1788929966.984838:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788929966.984840:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8a00, rc 0) 00000100:00100000:0.0:1788929966.984907:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:10234:x1875828747036288:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 902us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929966.984915:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 33 00000100:00100000:3.0:1788929966.987347:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929966.987565:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747036544 00000100:00100000:0.0:1788929966.987577:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747036544 00000100:00100000:0.0:1788929966.987631:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 34 00000100:00100000:0.0:1788929966.987640:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:10234:x1875828747036544:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788929966.987659:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929966.987678:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cb94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402101ce expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.987761:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cb9b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.987773:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cb9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.987784:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cb9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.987860:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cba2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.987867:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cba2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.987874:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cba2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988188:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237cba9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988198:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237cba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988205:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237cba9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929966.988214:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788929966.988555:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cb9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988572:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cb9b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988580:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cb9b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988586:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929966.988591:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cb9b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988598:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cb9b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988611:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2e83038e00) 00010000:00010000:0.0:1788929966.988614:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929966.988619:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cb9b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988625:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cb9b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988638:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cba2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988645:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cba2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988650:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cba2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988655:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929966.988664:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cba2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988670:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cba2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988679:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d2e83038f00) 00010000:00010000:0.0:1788929966.988681:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929966.988685:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cba2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.988690:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cba2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.989136:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cb94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ce expref: 10 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.989152:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237cba9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ce expref: 9 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929966.989160:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:0.0:1788929966.989162:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929966.989164:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8800, rc 0) 00000100:00100000:0.0:1788929966.989268:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:10234:x1875828747036544:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 1628us (1938us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788929966.989276:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 34 00000100:00100000:3.0:1788929966.992349:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929966.992445:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747036672 00000100:00100000:2.0:1788929966.992456:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747036672 00000100:00100000:2.0:1788929966.992522:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 35 00000100:00100000:2.0:1788929966.992534:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:10234:x1875828747036672:12345-192.168.204.40@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788929966.992648:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:10234:x1875828747036672:12345-192.168.204.40@tcp:59:lhsmtool_posix.0 Request processed in 117us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929966.992656:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 35 00000040:00080000:1.0:1788929967.388094:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788929967.515405:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929968.096073:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770142848:0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.096153:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929968.096213:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770143360:0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.096279:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929968.096308:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788929968.096314:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770142976:0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.096337:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929968.096354:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770143488:0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.096376:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929968.096420:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770143104:0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.096458:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929968.096487:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929968.096493:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770143232:0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.096514:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929968.096547:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770143360 00000100:00100000:0.0:1788929968.096555:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770143360 00000100:00100000:0.0:1788929968.096609:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770142976 00000100:00100000:0.0:1788929968.096612:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770142976 00000100:00100000:0.0:1788929968.096624:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770143104 00000100:00100000:0.0:1788929968.096626:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770143104 00000100:00100000:0.0:1788929968.096644:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788929968.096652:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770143360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.096703:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770143360:12345-0@lo:400:kworker.0 Request processed in 51us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929968.096710:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788929968.096728:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788929968.096734:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770142976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.096762:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770142976:12345-0@lo:400:kworker.0 Request processed in 28us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929968.096767:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788929968.096788:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788929968.096794:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770143104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.096824:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770143104:12345-0@lo:400:kworker.0 Request processed in 31us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929968.096830:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788929968.096850:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770143488 00000100:00100000:0.0:1788929968.096853:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770143488 00000100:00100000:0.0:1788929968.096874:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770143232 00000100:00100000:0.0:1788929968.096876:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770143232 00000100:00100000:0.0:1788929968.096891:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788929968.096896:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770143488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.097141:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770143488:12345-0@lo:400:kworker.0 Request processed in 244us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929968.097147:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788929968.097159:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788929968.097165:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770143232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.097192:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770143232:12345-0@lo:400:kworker.0 Request processed in 28us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929968.097198:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788929968.097282:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788929968.097287:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788929968.097289:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929968.097325:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770143232:0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.097336:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770143104:0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.097362:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770142976:0@lo:400:kworker.0 00000100:00100000:3.0:1788929968.097489:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770142848 00000100:00100000:3.0:1788929968.097494:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770142848 00000100:00100000:3.0:1788929968.097523:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788929968.097530:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770142848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929968.097564:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770142848:12345-0@lo:400:kworker.0 Request processed in 35us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929968.097569:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00010000:00080000:0.0:1788929968.097745:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebc829c00 x1875828770143488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788929984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929968.097766:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770143488:0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.097777:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770142848:0@lo:400:kworker.0 00000100:00100000:0.0:1788929968.097787:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770143360:0@lo:400:kworker.0 00000001:00080000:0.0:1788929968.211452:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:3.0:1788929968.545706:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929968.604244:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788929968.604293:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770143616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788929968.604361:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929968.604420:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770143616 00000100:00100000:2.0:1788929968.604428:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770143616 00000100:00100000:2.0:1788929968.604482:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788929968.604491:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770143616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788929968.604527:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929968.604574:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770143616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929968.604582:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1788929968.604622:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb597f100 x1875828770143616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788929984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788929968.604640:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770143616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788929969.539628:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.539865:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747036800 00000100:00100000:0.0:1788929969.539876:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747036800 00000100:00100000:0.0:1788929969.539995:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 36 00000100:00100000:0.0:1788929969.540005:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:10277:x1875828747036800:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929969.540028:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929969.540050:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cbb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402101d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540133:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540148:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540162:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540177:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540184:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540191:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540406:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540415:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbbe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540421:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540428:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929969.540432:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540449:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbbe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540461:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929969.540464:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929969.540469:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540474:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540484:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540489:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbc5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540494:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540505:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929969.540508:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540513:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbc5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540520:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d2e83038f00) 00010000:00010000:0.0:1788929969.540522:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929969.540524:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbc5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540529:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540562:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cbb7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101d5 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540572:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929969.540574:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929969.540577:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cbb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101d5 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.540587:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9800, rc 0) 00000100:00100000:0.0:1788929969.540939:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:10277:x1875828747036800:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 933us (1321us total) trans 0 rc 301/301 00000100:00100000:0.0:1788929969.540946:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 36 00000100:00080000:3.0:1788929969.541518:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788929969.546650:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929969.555537:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747037056 00000100:00100000:2.0:1788929969.555553:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747037056 00000100:00100000:2.0:1788929969.555637:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 37 00000100:00100000:2.0:1788929969.555650:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:10277:x1875828747037056:12345-192.168.204.40@tcp:36:lfs.0 00010000:00010000:2.0:1788929969.555709:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929969.555749:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e80031600/0xce4472dd2237cb71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101c0 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.555766:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:2.0:1788929969.555778:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788929969.556119:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237cbcc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.556134:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237cbcc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.556152:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237cbcc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.556167:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237cbd3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.556174:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237cbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.556181:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237cbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929969.558588:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788929969.558609:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237cbcc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.558632:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237cbcc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.558643:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237cbcc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.558650:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929969.558654:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237cbcc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.558663:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237cbcc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.558681:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e98756600) 00010000:00010000:2.0:1788929969.558684:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929969.558695:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237cbcc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.558703:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237cbcc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788929969.558723:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048d69e2c reply state 00000000978629e4 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237cbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929969.558732:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788929969.559265:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:10277:x1875828747037056:12345-192.168.204.40@tcp:36:lfs.0 Request processed in 3612us (12620us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788929969.559276:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 37 00010000:00010000:2.0:1788929969.562518:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237cbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.562537:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237cbd3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.562546:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237cbd3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.562553:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929969.562563:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237cbd3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.562573:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237cbd3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.562590:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d2e98756100) 00010000:00010000:2.0:1788929969.562593:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929969.562598:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237cbd3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.562681:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237cbd3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.564534:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929969.608199:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.608502:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747037184 00000100:00100000:0.0:1788929969.608644:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747037184 00000100:00100000:0.0:1788929969.608766:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 38 00000100:00100000:0.0:1788929969.608779:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:10285:x1875828747037184:12345-192.168.204.40@tcp:101:lctl.0 00010000:00010000:0.0:1788929969.608805:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929969.608830:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402101dc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.608897:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbe1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.608910:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.608923:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929969.608964:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788929969.608968:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929969.609008:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.609033:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101dc expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.609054:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101dc expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.609063:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038f00) 00010000:00010000:0.0:1788929969.609066:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788929969.609070:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8400, rc 0) 00000100:00100000:0.0:1788929969.609148:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:10285:x1875828747037184:12345-192.168.204.40@tcp:101:lctl.0 Request processed in 371us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929969.609155:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 38 00000100:00100000:3.0:1788929969.667973:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.668096:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747037312 00000100:00100000:0.0:1788929969.668108:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747037312 00000100:00100000:0.0:1788929969.668176:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:0.0:1788929969.668187:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:10291:x1875828747037312:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:0.0:1788929969.668207:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929969.668272:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402101e3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668336:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cbef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668349:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cbef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668360:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cbef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668372:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cbf6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668379:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cbf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668385:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cbf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668498:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9a00/0xce4472dd2237cbfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668526:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9a00/0xce4472dd2237cbfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668534:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9a00/0xce4472dd2237cbfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929969.668564:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788929969.668568:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929969.668607:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9a00/0xce4472dd2237cbfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668619:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cbef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668626:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cbef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668633:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cbef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668639:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929969.668643:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cbef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668650:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cbef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668660:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038f00) 00010000:00010000:0.0:1788929969.668663:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929969.668667:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cbef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668682:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cbef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668696:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cbf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668701:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cbf6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668707:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cbf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668711:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929969.668714:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cbf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668719:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cbf6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668725:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d2e83038400) 00010000:00010000:0.0:1788929969.668727:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929969.668729:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cbf6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668734:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cbf6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668765:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cbe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101e3 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668780:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9a00/0xce4472dd2237cbfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101e3 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.668793:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929969.668796:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788929969.668798:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9a00, rc 0) 00000100:00100000:0.0:1788929969.668859:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:10291:x1875828747037312:12345-192.168.204.40@tcp:101:bash.0 Request processed in 674us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929969.668866:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:2.0:1788929969.672011:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929969.672103:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747037568 00000100:00100000:1.0:1788929969.672113:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747037568 00000100:00100000:1.0:1788929969.672294:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:1.0:1788929969.672305:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:10291:x1875828747037568:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1788929969.672325:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929969.672344:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237cc04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402101ea expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.672474:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cc0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.672746:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cc0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.672762:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cc0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.672805:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cc12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.672813:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cc12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.672820:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cc12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788929969.673382:0:11024:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788929969.674028:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cc19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.674042:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cc19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.674051:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cc19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.674088:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cc0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.674096:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cc0b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.674103:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cc0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.674109:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929969.674114:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cc0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.674134:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cc0b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.674148:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:1.0:1788929969.674150:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929969.674155:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cc0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.674161:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cc0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788929969.674176:0:11024:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d547147 reply state 000000005f1bdccc transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cc12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929969.674185:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788929969.676596:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237cc04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ea expref: 13 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.676640:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cc19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ea expref: 12 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.676650:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2eb85fd000) 00010000:00010000:1.0:1788929969.676653:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788929969.676656:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152e00, rc 0) 00000100:00100000:1.0:1788929969.676734:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:10291:x1875828747037568:12345-192.168.204.40@tcp:101:bash.0 Request processed in 4429us (4730us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788929969.676743:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 40 00010000:00010000:0.0:1788929969.679005:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cc12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.679023:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cc12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.679032:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cc12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.679039:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929969.679045:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cc12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.679053:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cc12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.679070:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2eb85fdf00) 00010000:00010000:0.0:1788929969.679073:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929969.679077:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cc12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.679083:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cc12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929969.682030:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.682098:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747037696 00000100:00100000:0.0:1788929969.682107:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747037696 00000100:00100000:0.0:1788929969.682158:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:0.0:1788929969.682167:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875828747037696:12345-192.168.204.40@tcp:8:bash.0 00010000:00080000:0.0:1788929969.682199:0:6688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:0.0:1788929969.682257:0:6688:0:(genops.c:1384:class_connect()) connect: client 668b9f78-1e26-4a12-8f20-ad475b3553ba, cookie 0xce4472dd2237cc27 00002000:00100000:0.0:1788929969.682268:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 668b9f78-1e26-4a12-8f20-ad475b3553ba/ffff8d2ebc974000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788929969.682279:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788929969.682512:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788929969.682543:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8d2ebc971800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788929969.682777:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2358:x1875828747037696:12345-192.168.204.40@tcp:8:bash.0 Request processed in 608us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929969.682786:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:2.0:1788929969.684405:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.684495:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747037824 00000100:00100000:0.0:1788929969.684504:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747037824 00000100:00100000:0.0:1788929969.684602:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00100000:0.0:1788929969.684610:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:0:x1875828747037824:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:0.0:1788929969.684625:0:6989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929969.684643:0:6989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea8826bd/0xce4472dd2237cc2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402101f1 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788929969.684670:0:6989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788929969.684689:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1788929969.684693:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929969.684714:0:6989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8826bd/0xce4472dd2237cc2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f1 expref: 7 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.684734:0:6989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea8826bd/0xce4472dd2237cc2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f1 expref: 7 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.684748:0:6989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9c00, rc 0) 00000100:00100000:0.0:1788929969.684808:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:0:x1875828747037824:12345-192.168.204.40@tcp:101:bash.0 Request processed in 190us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929969.684815:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00080000:3.0:1788929969.685031:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788929969.687637:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929969.688517:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747037952 00000100:00100000:1.0:1788929969.688548:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747037952 00000100:00100000:1.0:1788929969.688650:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:1.0:1788929969.688660:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:10291:x1875828747037952:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1788929969.688677:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929969.688699:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402101f8 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.688738:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea8826bd/0xce4472dd2237cc2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f1 expref: 8 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.688747:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788929969.688752:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788929969.688757:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.688793:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea8826bd/0xce4472dd2237cc2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f1 expref: 8 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.688807:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea8826bd/0xce4472dd2237cc2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f1 expref: 8 pid: 6989 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929969.688822:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875828770143744:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929969.688933:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8678fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788929969.691953:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.692042:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747038080 00000100:00100000:0.0:1788929969.692052:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747038080 00010000:00010000:0.0:1788929969.692093:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8826bd/0xce4472dd2237cc2e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f1 expref: 9 pid: 6989 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929969.692140:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 35 00000100:00100000:0.0:1788929969.692151:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2361:x1875828747038080:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929969.692179:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929969.692205:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea8826bd/0xce4472dd2237cc2e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f1 expref: 9 pid: 6989 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.692219:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea8826bd/0xce4472dd2237cc2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f1 expref: 9 pid: 6989 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.692287:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929969.692292:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929969.692318:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.692329:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.692373:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929969.692388:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9ae1ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1875828770143872:192.168.204.40@tcp:105: 00000100:00100000:0.0:1788929969.692472:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9aebd780 going to sleep for 11 seconds 00010000:00010000:1.0:1788929969.692747:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8826bd/0xce4472dd2237cc2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f1 expref: 9 pid: 6989 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929969.692776:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875828770143744:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929969.692799:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.692810:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152c00, rc 0) 00000100:00100000:1.0:1788929969.693079:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:10291:x1875828747037952:12345-192.168.204.40@tcp:101:bash.0 Request processed in 4418us (5451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929969.693087:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:0.0:1788929969.696776:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9ae1ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1875828770143872:192.168.204.40@tcp:105: 00010000:00010000:0.0:1788929969.696818:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929969.696876:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747038080:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 4726us (4932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929969.696897:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 35 00000100:00100000:2.0:1788929969.698714:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929969.698794:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747038336 00000100:00100000:1.0:1788929969.698814:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747038336 00000100:00100000:1.0:1788929969.698872:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:1.0:1788929969.698941:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+12:10291:x1875828747038336:12345-192.168.204.40@tcp:35:bash.0 00000100:00100000:1.0:1788929969.699535:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:10291:x1875828747038336:12345-192.168.204.40@tcp:35:bash.0 Request processed in 596us (829us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788929969.699543:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:2.0:1788929969.754031:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.754478:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747038592 00000100:00100000:0.0:1788929969.754490:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747038592 00000100:00100000:0.0:1788929969.754559:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 41 00000100:00100000:0.0:1788929969.754569:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:10301:x1875828747038592:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929969.754594:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929969.754615:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402101ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929969.754704:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788929969.754993:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc3c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ff expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.755020:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038f00) 00010000:00010000:0.0:1788929969.755023:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788929969.755029:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ff expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.755042:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8c00, rc 0) 00000100:00100000:0.0:1788929969.755139:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:10301:x1875828747038592:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 571us (1119us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788929969.755147:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 41 00000100:00100000:2.0:1788929969.760431:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.760555:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747038848 00000100:00100000:0.0:1788929969.760566:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747038848 00000100:00100000:0.0:1788929969.760635:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:0.0:1788929969.760648:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:10301:x1875828747038848:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:0.0:1788929969.760964:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:10301:x1875828747038848:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 317us (544us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788929969.760973:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:3.0:1788929969.817750:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.818020:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747038976 00000100:00100000:0.0:1788929969.818031:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747038976 00000100:00100000:0.0:1788929969.818096:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 42 00000100:00100000:0.0:1788929969.818107:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:10307:x1875828747038976:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929969.818133:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929969.818157:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210206 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.818254:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cc51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.818295:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cc51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.818308:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cc51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929969.818345:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788929969.818349:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929969.818367:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cc51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.818395:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210206 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.818416:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cc51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210206 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.818424:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929969.818428:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788929969.818432:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8200, rc 0) 00000100:00100000:0.0:1788929969.818508:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:10307:x1875828747038976:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 402us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929969.818516:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 42 00000100:00100000:2.0:1788929969.824091:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.824171:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747039232 00000100:00100000:0.0:1788929969.824182:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747039232 00000100:00100000:0.0:1788929969.824276:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00100000:0.0:1788929969.824299:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:10307:x1875828747039232:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929969.824323:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929969.824361:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cc58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021020d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.824482:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cc5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.824497:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cc5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.824510:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cc5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929969.824522:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788929969.824652:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cc58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021020d expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.824671:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cc5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021020d expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.824680:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2eb85fd000) 00010000:00010000:0.0:1788929969.824684:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929969.824688:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9c00, rc 0) 00000100:00100000:0.0:1788929969.824754:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:10307:x1875828747039232:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 459us (673us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788929969.824762:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00100000:2.0:1788929969.828161:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929969.828983:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.829061:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747039616 00000100:00100000:0.0:1788929969.829072:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747039616 00000100:00100000:0.0:1788929969.829135:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 44 00000100:00100000:0.0:1788929969.829146:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:10307:x1875828747039616:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929969.829186:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929969.829208:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210214 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.829356:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cc74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.829372:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cc74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.829392:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cc74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929969.829409:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:1.0:1788929969.829429:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747039360 00000100:00100000:1.0:1788929969.829452:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747039360 00000100:00100000:1.0:1788929969.829506:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:1.0:1788929969.829516:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:2362:x1875828747039360:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929969.829528:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929969.829549:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cc5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021020d expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.829574:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210214 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.829586:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2eb85fd000) 00010000:00010000:1.0:1788929969.829692:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929969.829754:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:2362:x1875828747039360:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 239us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929969.829763:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2 00010000:00010000:0.0:1788929969.830139:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cc74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210214 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.830150:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2eb85fd000) 00010000:00010000:0.0:1788929969.830153:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788929969.830156:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9800, rc 0) 00000100:00100000:0.0:1788929969.830256:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:10307:x1875828747039616:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1111us (1275us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788929969.830264:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 44 00000100:00100000:2.0:1788929969.839656:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.839711:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747039744 00000100:00100000:0.0:1788929969.839720:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747039744 00000100:00100000:0.0:1788929969.839778:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00100000:0.0:1788929969.839804:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2360:x1875828747039744:12345-192.168.204.40@tcp:1:lfs.0 00010000:00010000:0.0:1788929969.839865:0:6989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.839896:0:6989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.839905:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929969.839910:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929969.839914:0:6989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.839949:0:6989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.839964:0:6989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 7 pid: 6685 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929969.839979:0:6989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9ae1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6989:1875828770144000:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929969.840110:0:6989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244180 going to sleep for 11 seconds 00000100:00100000:2.0:1788929969.844998:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929969.845110:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747039872 00000100:00100000:3.0:1788929969.845121:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747039872 00002000:00100000:3.0:1788929969.845173:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8d2eb597df80 x1875828747039872/t0(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:515/0 lens 504/0 e 0 to 0 dl 1788929980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788929969.845184:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2eb597df80 with x1875828747039872 ext(0->12) 00010000:00010000:3.0:1788929969.845195:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 8 pid: 6685 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929969.845214:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 8 pid: 6685 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788929969.845285:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d2eb597df80 00000100:00100000:3.0:1788929969.845313:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:3.0:1788929969.845322:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2362:x1875828747039872:12345-192.168.204.40@tcp:4:lfs.0 00000100:00100000:0.0:1788929969.846190:0:6989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9ae1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6989:1875828770144000:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929969.846216:0:6989:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788929969.953358:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 668b9f78-1e26-4a12-8f20-ad475b3553ba 00000100:00100000:2.0:1788929969.954383:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2362:x1875828747039872:12345-192.168.204.40@tcp:4:lfs.0 Request processed in 109054us (109387us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788929969.954401:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00002000:00100000:2.0:1788929969.954415:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8d2eb597df80 x1875828747039872/t4294967299(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:515/0 lens 504/448 e 0 to 0 dl 1788929980 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788929969.954426:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2eb597df80 with x1875828747039872 ext(0->12) 00010000:00010000:2.0:1788929969.954447:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 9 pid: 6685 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.954466:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 9 pid: 6685 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788929969.954488:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d2eb597df80 00000100:00100000:3.0:1788929969.957708:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.958567:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747040000 00000100:00100000:0.0:1788929969.958596:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747040000 00010000:00010000:0.0:1788929969.958644:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 9 pid: 6685 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929969.958741:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 36 00000100:00100000:0.0:1788929969.958752:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2359:x1875828747040000:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929969.958768:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788929969.958791:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788929969.958794:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788929968 00002000:00010000:0.0:1788929969.958797:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788929968 00002000:00010000:0.0:1788929969.958799:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788929968 00010000:00010000:0.0:1788929969.958806:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 9 pid: 6685 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.958819:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 9 pid: 6685 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.958850:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000681b8142/0xce4472dd2237cc35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101f8 expref: 9 pid: 6685 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.958871:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788929969.958876:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929969.958895:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.958905:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.958954:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929969.959031:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2359:x1875828747040000:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 280us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929969.959039:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 36 00010000:00010000:1.0:1788929969.959104:0:6989:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.959116:0:6989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.959142:0:6989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.959150:0:6989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.959159:0:6989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.959166:0:6989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8e00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788929969.959170:0:6989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.959179:0:6989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.959202:0:6989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.959211:0:6989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237cc82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929969.959288:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2360:x1875828747039744:12345-192.168.204.40@tcp:1:lfs.0 Request processed in 119476us (119633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929969.959297:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00100000:3.0:1788929969.961835:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.961989:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747040256 00000100:00100000:0.0:1788929969.961998:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747040256 00000100:00100000:0.0:1788929969.962047:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:0.0:1788929969.962055:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:10307:x1875828747040256:12345-192.168.204.40@tcp:35:lfs.0 00000004:00010000:0.0:1788929969.962114:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cc74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210214 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788929969.962449:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788929969.962510:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788929969.963398:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788929969.963489:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.963510:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cc19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ea expref: 23 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.963519:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.963557:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cc19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ea expref: 23 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.963572:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cc19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ea expref: 23 pid: 11024 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929969.963595:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9ae1ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1875828770144128:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929969.963679:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244300 going to sleep for 11 seconds 00000100:00100000:3.0:1788929969.969489:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929969.969637:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747040384 00000100:00100000:1.0:1788929969.969649:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747040384 00010000:00010000:1.0:1788929969.969706:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cc19 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ea expref: 24 pid: 11024 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929969.969748:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 37 00000100:00100000:1.0:1788929969.969758:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:2361:x1875828747040384:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929969.969816:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929969.969828:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cc19 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ea expref: 24 pid: 11024 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.969842:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cc19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ea expref: 24 pid: 11024 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.969864:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2eb85fd000) 00010000:00010000:1.0:1788929969.969869:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.969898:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.969906:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929969.969939:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929969.970003:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:2361:x1875828747040384:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 245us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929969.970010:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 37 00010000:00010000:0.0:1788929969.970820:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cc19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ea expref: 23 pid: 11024 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929969.970842:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9ae1ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1875828770144128:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929969.970871:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.971054:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.971063:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788929969.971200:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788929969.971488:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788929969.971616:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9ae1ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875828770144256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788929969.971719:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929969.971746:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244240 going to sleep for 11 seconds 00000100:00100000:1.0:1788929969.972328:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770144256 00000100:00100000:1.0:1788929969.972337:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770144256 00000100:00100000:1.0:1788929969.972388:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788929969.972398:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875828770144256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788929969.972505:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875828770144256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 108us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929969.972512:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788929969.972706:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9ae1ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875828770144256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788929969.975239:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788929969.975569:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9ae1ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875828770144384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788929969.975723:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929969.975748:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244300 going to sleep for 11 seconds 00000100:00100000:1.0:1788929969.975858:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770144384 00000100:00100000:1.0:1788929969.975868:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770144384 00000100:00100000:1.0:1788929969.975940:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788929969.975950:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875828770144384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788929969.976164:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875828770144384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 215us (441us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788929969.976172:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788929969.976746:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9ae1ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875828770144384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788929969.976893:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788929969.976937:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.976948:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.976956:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.976963:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929969.976967:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.976975:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.976990:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2eb85fd000) 00010000:00010000:0.0:1788929969.976993:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788929969.976999:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.977006:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cc89 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788929969.977179:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788929969.977531:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788929969.977543:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355133318314ns, next at 356133316005ns, rc = 0 00000001:00080000:0.0:1788929969.977550:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788929969.977584:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2eb85fd000) 00010000:00010000:0.0:1788929969.977588:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788929969.977869:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cc74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210214 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929969.977996:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:10307:x1875828747040256:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 15940us (16167us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788929969.978009:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000020:00080000:0.0:1788929969.978014:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788929969.981577:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929969.981702:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747040512 00000100:00100000:0.0:1788929969.981713:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747040512 00000100:00100000:0.0:1788929969.981774:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 45 00000100:00100000:0.0:1788929969.981785:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:10307:x1875828747040512:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929969.981810:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929969.981912:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237cc90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021021b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.981980:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237cc90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021021b expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929969.981997:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237cc90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021021b expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929969.982096:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:2.0:1788929969.982101:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788929969.982104:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9400, rc 0) 00000100:00100000:2.0:1788929969.982219:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:10307:x1875828747040512:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 435us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929969.982249:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 45 00000100:00100000:3.0:1788929969.984754:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929969.984859:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747040768 00000100:00100000:1.0:1788929969.984870:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747040768 00000100:00100000:1.0:1788929969.985050:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788929969.985074:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90957c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:10307:x1875828747040768:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:1.0:1788929969.985342:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90957c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+28:10307:x1875828747040768:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 269us (601us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788929969.985350:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788929970.058144:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929970.058258:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747041024 00000100:00100000:2.0:1788929970.058269:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747041024 00000100:00100000:2.0:1788929970.058331:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 46 00000100:00100000:2.0:1788929970.058340:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+28:10317:x1875828747041024:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788929970.058365:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929970.058385:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cc97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210222 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929970.058492:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788929970.058633:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cc97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210222 expref: 30 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.058648:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038f00) 00010000:00010000:2.0:1788929970.058651:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788929970.058656:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cc97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210222 expref: 30 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.058670:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341200, rc 0) 00000100:00100000:2.0:1788929970.058740:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:10317:x1875828747041024:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 400us (606us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788929970.058761:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 46 00000100:00100000:2.0:1788929970.062530:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929970.063685:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747041152 00000100:00100000:3.0:1788929970.063697:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747041152 00000100:00100000:3.0:1788929970.064456:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 47 00000100:00100000:3.0:1788929970.064470:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:10317:x1875828747041152:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:3.0:1788929970.064563:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cca5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.064581:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.064593:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.064617:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237ccac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.064624:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237ccac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.064648:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237ccac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.064847:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ccb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.064856:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ccb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.064863:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ccb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788929970.065029:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ccb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065043:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065049:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cca5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065056:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cca5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065061:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929970.065065:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cca5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065073:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cca5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065084:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:3.0:1788929970.065092:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929970.065097:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cca5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065103:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cca5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065115:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237ccac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065120:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237ccac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065126:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237ccac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065131:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929970.065134:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237ccac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065139:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237ccac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065145:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e907e4c00) 00010000:00010000:3.0:1788929970.065147:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929970.065149:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237ccac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065154:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237ccac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065169:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ccb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065178:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ccb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065184:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ccb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065189:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929970.065192:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ccb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065197:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ccb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065204:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:3.0:1788929970.065206:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929970.065208:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ccb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.065213:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ccb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929970.065464:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:10317:x1875828747041152:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 996us (2941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929970.065473:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 47 00000100:00100000:2.0:1788929970.068493:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929970.068595:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747041408 00000100:00100000:0.0:1788929970.068673:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747041408 00000100:00100000:0.0:1788929970.068884:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:0.0:1788929970.068895:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:10317:x1875828747041408:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:0.0:1788929970.069123:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+30:10317:x1875828747041408:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 229us (911us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788929970.069145:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:1.0:1788929970.120148:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929970.120262:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747041664 00000100:00100000:2.0:1788929970.120287:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747041664 00000100:00100000:2.0:1788929970.120352:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00100000:2.0:1788929970.120362:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+30:10320:x1875828747041664:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788929970.120388:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929970.120410:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237ccba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210229 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.120496:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ccc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.120509:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ccc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.120522:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ccc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.120536:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ccc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.120543:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ccc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.120549:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ccc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.120676:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237cccf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.120698:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237cccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.120704:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237cccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929970.120713:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788929970.121542:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ccc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.121551:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ccc1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.121558:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ccc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.121572:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929970.121576:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ccc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.121584:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ccc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.121596:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:3.0:1788929970.121668:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929970.121674:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ccc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.121680:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ccc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.121696:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ccc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.121702:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ccc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.121708:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ccc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.121713:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929970.121788:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ccc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.121795:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ccc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.122007:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e98756600) 00010000:00010000:3.0:1788929970.122010:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929970.122013:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ccc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.122019:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ccc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.122073:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237ccba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210229 expref: 33 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.122089:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237cccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210229 expref: 32 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.122097:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:3.0:1788929970.122099:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788929970.122101:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341c00, rc 0) 00000100:00100000:3.0:1788929970.122196:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:10320:x1875828747041664:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1835us (2059us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788929970.122205:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00100000:2.0:1788929970.124849:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929970.124984:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747041792 00000100:00100000:0.0:1788929970.124996:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747041792 00000100:00100000:0.0:1788929970.125048:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 49 00000100:00100000:0.0:1788929970.125058:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:10320:x1875828747041792:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:0.0:1788929970.125123:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ccdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.125139:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ccdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.125150:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ccdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.125338:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ccdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.125346:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ccdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.125352:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ccdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.125358:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929970.125363:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ccdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.125449:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ccdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.125463:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788929970.125480:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788929970.125486:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ccdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.125492:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ccdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929970.125570:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:10320:x1875828747041792:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 513us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929970.125578:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 49 00000100:00100000:2.0:1788929970.128048:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929970.128151:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747042048 00000100:00100000:1.0:1788929970.128263:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747042048 00000100:00100000:1.0:1788929970.128579:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:1.0:1788929970.128589:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:10320:x1875828747042048:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:1.0:1788929970.129002:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+33:10320:x1875828747042048:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 413us (962us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788929970.129010:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:0.0:1788929970.140525:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929970.140550:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770144512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788929970.140620:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929970.140966:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770144512 00000100:00100000:1.0:1788929970.140975:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770144512 00000100:00080000:3.0:1788929970.141101:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788929970.141143:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788929970.141162:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770144512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788929970.141198:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929970.141289:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770144512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929970.141297:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788929970.141383:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770144512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788929970.361320:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929970.363280:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747042304 00000100:00100000:0.0:1788929970.363299:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747042304 00000100:00100000:0.0:1788929970.363389:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 50 00000100:00100000:0.0:1788929970.363399:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+33:10351:x1875828747042304:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:0.0:1788929970.363445:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929970.363476:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cce4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210230 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.363659:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cceb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.363673:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.363683:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929970.363712:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788929970.363873:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cce4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210230 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.363896:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210230 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.363905:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788929970.363908:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929970.363912:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8c00, rc 0) 00000100:00100000:0.0:1788929970.363997:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:10351:x1875828747042304:12345-192.168.204.40@tcp:101:cat.0 Request processed in 599us (2685us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788929970.364005:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 50 00000100:00100000:2.0:1788929970.369697:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929970.369838:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929970.369918:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747042688 00000100:00100000:3.0:1788929970.369928:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747042688 00000100:00100000:3.0:1788929970.370000:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:3.0:1788929970.370010:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:2360:x1875828747042688:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929970.370025:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929970.370061:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cceb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210230 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.370077:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:3.0:1788929970.370082:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929970.370141:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:2360:x1875828747042688:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 133us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929970.370149:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:0.0:1788929970.371457:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747042560 00000100:00100000:0.0:1788929970.371467:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747042560 00000100:00100000:0.0:1788929970.371572:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:0.0:1788929970.371583:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:10351:x1875828747042560:12345-192.168.204.40@tcp:35:cat.0 00000100:00100000:0.0:1788929970.371828:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:10351:x1875828747042560:12345-192.168.204.40@tcp:35:cat.0 Request processed in 247us (2140us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788929970.371836:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:2.0:1788929970.428549:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929970.429777:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747042944 00000100:00100000:3.0:1788929970.429790:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747042944 00000100:00100000:3.0:1788929970.429852:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 51 00000100:00100000:3.0:1788929970.429864:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:10357:x1875828747042944:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1788929970.429894:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929970.429913:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788929970.429945:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cc51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210206 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.429966:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:3.0:1788929970.429971:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788929970.429985:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ccf9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210237 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.430087:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.430103:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237cccf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210229 expref: 35 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.430129:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.430163:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237cccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210229 expref: 35 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.430176:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237cccf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210229 expref: 35 pid: 11024 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929970.430190:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770144640:192.168.204.40@tcp:104: 00000100:00100000:3.0:1788929970.430343:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e88011600 going to sleep for 11 seconds 00000100:00100000:3.0:1788929970.434408:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770144640:192.168.204.40@tcp:104: 00010000:00010000:3.0:1788929970.434450:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929970.435126:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929970.435363:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747043072 00000100:00100000:1.0:1788929970.435372:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747043072 00010000:00010000:1.0:1788929970.435416:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237cccf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210229 expref: 36 pid: 11024 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929970.435487:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 38 00000100:00100000:1.0:1788929970.435498:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:2361:x1875828747043072:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929970.435513:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929970.435520:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237cccf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210229 expref: 36 pid: 11024 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929970.435532:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237cccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210229 expref: 36 pid: 11024 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929970.435553:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237cccf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210229 expref: 36 pid: 11024 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929970.435571:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:1.0:1788929970.435576:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929970.435586:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929970.435593:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929970.435620:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788929970.435653:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.435664:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929970.435685:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:1.0:1788929970.435687:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:2361:x1875828747043072:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 189us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929970.435696:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 38 00010000:00010000:3.0:1788929970.435895:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ccf9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210237 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.435912:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210237 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.435933:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:3.0:1788929970.435935:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788929970.435938:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596400, rc 0) 00000100:00100000:3.0:1788929970.435965:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:10357:x1875828747042944:12345-192.168.204.40@tcp:101:dd.0 Request processed in 6104us (7426us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788929970.435972:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 51 00000100:00100000:2.0:1788929970.442779:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929970.442950:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747043328 00000100:00100000:0.0:1788929970.442961:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747043328 00000100:00100000:0.0:1788929970.443022:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 52 00000100:00100000:0.0:1788929970.443034:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:10357:x1875828747043328:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:0.0:1788929970.443449:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237cd0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.443484:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237cd0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.443499:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237cd0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788929970.443563:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788929970.443589:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fc4714e reply state 000000006880f1e0 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237cd0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929970.443598:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788929970.443851:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:10357:x1875828747043328:12345-192.168.204.40@tcp:36:dd.0 Request processed in 817us (1082us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788929970.443859:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 52 00000020:00080000:0.0:1788929970.443865:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788929970.445606:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237cd0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.445622:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237cd0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.445630:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237cd0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.445637:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929970.445642:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237cd0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.445650:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237cd0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.445688:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:2.0:1788929970.445691:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929970.445696:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237cd0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.445702:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237cd0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929970.587693:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929970.652309:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929970.652356:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929970.654788:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929970.654895:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747043584 00000100:00100000:0.0:1788929970.654905:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747043584 00000100:00100000:0.0:1788929970.654972:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:0.0:1788929970.654983:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747043584:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788929970.655053:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747043584:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 73us (2754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929970.655061:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:1.0:1788929970.655123:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747043456 00000100:00100000:1.0:1788929970.655129:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747043456 00000100:00100000:3.0:1788929970.655146:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747043712 00000100:00100000:3.0:1788929970.655152:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747043712 00000100:00100000:3.0:1788929970.655206:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 137 00000100:00100000:3.0:1788929970.655214:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2361:x1875828747043712:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929970.655260:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2361:x1875828747043712:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 47us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929970.655267:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 137 00000100:00080000:0.0:1788929970.655335:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929970.655388:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 286 00000100:00100000:1.0:1788929970.655401:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2361:x1875828747043456:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929970.655453:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2361:x1875828747043456:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 55us (3095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929970.655461:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 286 00000100:00100000:0.0:1788929970.665532:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929970.665619:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747043840 00000100:00100000:3.0:1788929970.665631:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747043840 00000100:00100000:3.0:1788929970.665690:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 53 00000100:00100000:3.0:1788929970.665699:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:10371:x1875828747043840:12345-192.168.204.40@tcp:101:stat.0 00010000:00010000:3.0:1788929970.665724:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929970.665744:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cd15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021023e expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.665811:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cd1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.665826:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cd1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.665855:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cd1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.665881:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cd23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.665889:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cd23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.665895:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cd23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.665995:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.666006:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210237 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.666015:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd2a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.666047:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210237 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.666062:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210237 expref: 38 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929970.666076:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770144768:192.168.204.40@tcp:104: 00000100:00100000:3.0:1788929970.666179:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e88011a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788929970.669283:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929970.669406:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747044096 00000100:00100000:1.0:1788929970.669416:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747044096 00000100:00100000:1.0:1788929970.669482:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:1.0:1788929970.669492:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+39:5598:x1875828747044096:12345-192.168.204.40@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788929970.669842:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+40:5598:x1875828747044096:12345-192.168.204.40@tcp:35:ldlm_bl.0 Request processed in 350us (569us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788929970.669850:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:3.0:1788929970.670633:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770144768:192.168.204.40@tcp:104: 00010000:00010000:3.0:1788929970.670659:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929970.673947:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929970.674074:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747044224 00000100:00100000:3.0:1788929970.674085:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747044224 00010000:00010000:3.0:1788929970.674129:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210237 expref: 40 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929970.674171:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:3.0:1788929970.674180:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+40:2362:x1875828747044224:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929970.674194:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929970.674200:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210237 expref: 40 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.674213:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210237 expref: 40 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.674278:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210237 expref: 40 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.674294:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:3.0:1788929970.674299:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.674309:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.674316:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd2a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.674363:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929970.674428:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+39:2362:x1875828747044224:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 239us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929970.674437:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 39 00010000:00010000:0.0:1788929970.674506:0:11024:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674515:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929970.674562:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788929970.674566:0:11024:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929970.674602:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674613:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674622:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cd1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674629:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cd1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674634:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cd1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674640:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929970.674643:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cd1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674651:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cd1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674659:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929970.674661:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929970.674665:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cd1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674670:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cd1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674688:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cd23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674694:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cd23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674699:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cd23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674703:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929970.674705:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cd23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674710:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cd23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674715:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e907e4c00) 00010000:00010000:0.0:1788929970.674717:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929970.674719:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cd23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674723:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cd23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674753:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cd15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021023e expref: 39 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674763:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021023e expref: 38 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.674777:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788929970.674779:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929970.674781:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597600, rc 0) 00000100:00100000:0.0:1788929970.674804:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:10371:x1875828747043840:12345-192.168.204.40@tcp:101:stat.0 Request processed in 9107us (9282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929970.674809:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 53 00000100:00100000:2.0:1788929970.733318:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929970.736396:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747044480 00000100:00100000:3.0:1788929970.736416:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747044480 00000100:00100000:3.0:1788929970.736518:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 54 00000100:00100000:3.0:1788929970.736529:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:10377:x1875828747044480:12345-192.168.204.40@tcp:36:truncate.0 00010000:00010000:3.0:1788929970.736590:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929970.736620:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021023e expref: 38 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.736641:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:3.0:1788929970.736646:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788929970.736862:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.736875:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929970.736885:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788929970.736948:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788929970.736971:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec314ff7 reply state 00000000c1da95fd transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929970.736979:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788929970.737120:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+40:10377:x1875828747044480:12345-192.168.204.40@tcp:36:truncate.0 Request processed in 592us (3809us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788929970.737127:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 54 00000020:00080000:3.0:1788929970.737132:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788929970.745093:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.745112:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.745121:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.745127:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929970.745132:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.745140:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.745155:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788929970.745158:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929970.745163:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.745169:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cd31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929970.853536:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929970.854135:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747044608 00000100:00100000:0.0:1788929970.854152:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747044608 00000100:00100000:0.0:1788929970.854219:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 55 00000100:00100000:0.0:1788929970.854251:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+39:10391:x1875828747044608:12345-192.168.204.40@tcp:101:stat.0 00010000:00010000:0.0:1788929970.854283:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929970.854306:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cd38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210245 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854376:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854391:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854407:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854437:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854446:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854458:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854664:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cd4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854673:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cd4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854692:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cd4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929970.854731:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788929970.854736:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929970.854756:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cd4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854768:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cd4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854777:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854784:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd3f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854791:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854951:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929970.854956:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854965:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd3f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.854978:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929970.854981:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929970.854986:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.855003:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.855019:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.855024:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.855030:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.855034:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929970.855037:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.855042:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.855048:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e83038700) 00010000:00010000:0.0:1788929970.855051:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929970.855054:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.855059:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.855094:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cd38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210245 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.855107:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cd4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210245 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.855121:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788929970.855123:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929970.855126:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9e00, rc 0) 00000100:00100000:0.0:1788929970.855200:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+40:10391:x1875828747044608:12345-192.168.204.40@tcp:101:stat.0 Request processed in 951us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929970.855207:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 55 00000100:00100000:2.0:1788929970.922091:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929970.922218:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747044864 00000100:00100000:3.0:1788929970.922330:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747044864 00000100:00100000:2.0:1788929970.922684:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 56 00000100:00100000:2.0:1788929970.922694:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+40:10401:x1875828747044864:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788929970.922715:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929970.922736:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237cd54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021024c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929970.922943:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788929970.923065:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237cd54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021024c expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.923080:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038f00) 00010000:00010000:2.0:1788929970.923096:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788929970.923103:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237cd54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021024c expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929970.923117:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341000, rc 0) 00000100:00100000:2.0:1788929970.923274:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+41:10401:x1875828747044864:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 573us (1184us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788929970.923281:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 56 00000100:00100000:2.0:1788929970.925456:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929970.925797:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747045120 00000100:00100000:1.0:1788929970.925808:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747045120 00000100:00100000:1.0:1788929970.925875:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:1.0:1788929970.925886:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+41:10401:x1875828747045120:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:1.0:1788929970.926122:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+42:10401:x1875828747045120:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 237us (675us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788929970.926130:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:3.0:1788929970.982189:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929970.982400:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747045376 00000100:00100000:0.0:1788929970.982424:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747045376 00000100:00100000:0.0:1788929970.982490:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 57 00000100:00100000:0.0:1788929970.982511:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+42:10407:x1875828747045376:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:0.0:1788929970.982535:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929970.982556:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cd62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210253 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.982652:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.982668:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cd4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210245 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.982678:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.982718:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cd4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210245 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.982732:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cd4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210245 expref: 43 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929970.982760:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9ae1ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770144896:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929970.982851:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244780 going to sleep for 11 seconds 00000100:00100000:3.0:1788929970.990144:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929970.990454:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9ae1ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770144896:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929970.990485:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929970.991079:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747045504 00000100:00100000:1.0:1788929970.991088:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747045504 00010000:00010000:1.0:1788929970.991130:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cd4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210245 expref: 44 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929970.991191:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:1.0:1788929970.991202:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+44:2362:x1875828747045504:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929970.991249:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929970.991405:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cd4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210245 expref: 44 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929970.991430:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cd4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210245 expref: 44 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929970.991454:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cd4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210245 expref: 44 pid: 5841 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929970.991475:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:1.0:1788929970.991480:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929970.991489:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929970.991498:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929970.991568:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929970.991630:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+43:2362:x1875828747045504:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 429us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929970.991637:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 40 00010000:00010000:0.0:1788929970.992687:0:11024:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.992699:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929970.992720:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788929970.993045:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cd62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210253 expref: 44 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.993064:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210253 expref: 43 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.993072:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788929970.993075:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788929970.993078:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9200, rc 0) 00000100:00100000:0.0:1788929970.993171:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+43:10407:x1875828747045376:12345-192.168.204.40@tcp:101:bash.0 Request processed in 10670us (10990us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788929970.993178:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 57 00000100:00100000:3.0:1788929970.997085:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929970.997156:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747045760 00000100:00100000:0.0:1788929970.997181:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747045760 00000100:00100000:0.0:1788929970.997278:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 58 00000100:00100000:0.0:1788929970.997290:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+43:10407:x1875828747045760:12345-192.168.204.40@tcp:36:bash.0 00010000:00010000:0.0:1788929970.997602:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.997623:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929970.997634:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788929970.997687:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788929970.997712:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f804ed8 reply state 000000002a25ed38 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929970.997720:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788929970.997821:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+46:10407:x1875828747045760:12345-192.168.204.40@tcp:36:bash.0 Request processed in 533us (747us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788929970.997828:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 58 00000020:00080000:0.0:1788929970.997834:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788929971.002817:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.002835:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.002843:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.002849:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929971.002854:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.002873:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.002892:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:3.0:1788929971.002895:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929971.002900:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.002906:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cd77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929971.004111:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929971.004203:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747045888 00000100:00100000:2.0:1788929971.004215:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747045888 00000100:00100000:2.0:1788929971.004333:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 59 00000100:00100000:2.0:1788929971.004343:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+45:10407:x1875828747045888:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:2.0:1788929971.004370:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929971.004400:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237cd7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021025a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.004498:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237cd85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.004511:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210253 expref: 46 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.004519:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237cd85 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.004554:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210253 expref: 46 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.004582:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210253 expref: 46 pid: 11024 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929971.004595:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc82c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875828770145024:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788929971.004680:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e91701cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1788929971.004880:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788929971.007904:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.008016:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc82c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875828770145024:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929971.008046:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237cd85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929971.008365:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747046016 00000100:00100000:3.0:1788929971.008373:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747046016 00010000:00010000:2.0:1788929971.008689:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210253 expref: 47 pid: 11024 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929971.008773:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 41 00000100:00100000:2.0:1788929971.008782:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+47:2362:x1875828747046016:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788929971.008809:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929971.008816:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210253 expref: 47 pid: 11024 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.008829:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210253 expref: 47 pid: 11024 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.008849:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cd69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210253 expref: 47 pid: 11024 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.008874:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:2.0:1788929971.008880:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237cd85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.008906:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237cd85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.008913:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237cd85 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.008940:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929971.008995:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+46:2362:x1875828747046016:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 213us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929971.009002:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 41 00010000:00010000:0.0:1788929971.009055:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237cd85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.009063:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237cd85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929971.009118:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788929971.009122:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929971.009142:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237cd85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.009170:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237cd7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021025a expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.009184:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237cd85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021025a expref: 45 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.009191:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788929971.009193:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929971.009196:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340000, rc 0) 00000100:00100000:0.0:1788929971.009248:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+45:10407:x1875828747045888:12345-192.168.204.40@tcp:101:bash.0 Request processed in 4882us (5122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929971.009263:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 59 00000100:00100000:2.0:1788929971.017150:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929971.017276:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747046272 00000100:00100000:1.0:1788929971.017299:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747046272 00000100:00100000:1.0:1788929971.017363:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:1.0:1788929971.017374:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90954050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+45:10407:x1875828747046272:12345-192.168.204.40@tcp:35:bash.0 00000100:00100000:1.0:1788929971.018171:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90954050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+46:10407:x1875828747046272:12345-192.168.204.40@tcp:35:bash.0 Request processed in 795us (1026us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788929971.018181:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:3.0:1788929971.080602:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.080678:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747046528 00000100:00100000:0.0:1788929971.080690:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747046528 00000100:00100000:0.0:1788929971.080758:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 60 00000100:00100000:0.0:1788929971.080769:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+46:10417:x1875828747046528:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929971.080798:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929971.080820:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cd8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210261 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929971.080922:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788929971.081056:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cd8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210261 expref: 48 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.081087:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038f00) 00010000:00010000:0.0:1788929971.081090:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788929971.081095:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cd8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210261 expref: 48 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.081108:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8600, rc 0) 00000100:00100000:0.0:1788929971.081177:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+47:10417:x1875828747046528:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 410us (586us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788929971.081184:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 60 00000100:00100000:2.0:1788929971.083351:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929971.083442:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747046656 00000100:00100000:3.0:1788929971.083454:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747046656 00000100:00100000:3.0:1788929971.083548:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:3.0:1788929971.083558:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+47:10417:x1875828747046656:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:3.0:1788929971.083631:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083647:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083659:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083674:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237cda1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083681:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237cda1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083687:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237cda1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083783:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cda8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083792:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cda8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083813:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cda8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788929971.083855:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cda8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083868:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083875:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083881:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083887:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929971.083892:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083899:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083910:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:3.0:1788929971.083913:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929971.083917:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083924:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cd9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083936:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237cda1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083948:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237cda1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083955:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237cda1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083959:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929971.083962:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237cda1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083968:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237cda1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083975:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e907e4a00) 00010000:00010000:3.0:1788929971.083977:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929971.083980:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237cda1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.083991:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237cda1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.084010:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cda8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.084016:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cda8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.084022:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cda8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.084027:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929971.084035:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cda8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.084041:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cda8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.084049:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:3.0:1788929971.084050:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929971.084053:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cda8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.084059:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237cda8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929971.084136:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+47:10417:x1875828747046656:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 579us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929971.084144:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:0.0:1788929971.087700:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929971.087780:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747046912 00000100:00100000:2.0:1788929971.087792:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747046912 00000100:00100000:2.0:1788929971.087928:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:2.0:1788929971.087938:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+47:10417:x1875828747046912:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:2.0:1788929971.088213:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+48:10417:x1875828747046912:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 275us (524us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788929971.088372:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:2.0:1788929971.118736:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.118915:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747047168 00000100:00100000:0.0:1788929971.118927:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747047168 00000100:00100000:0.0:1788929971.118997:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:0.0:1788929971.119011:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+48:10420:x1875828747047168:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929971.119043:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929971.119069:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210268 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119153:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cdb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119167:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cdb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119179:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cdb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119248:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119257:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119265:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119390:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cdc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119400:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119406:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929971.119428:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788929971.119693:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cdb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119701:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cdb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119707:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cdb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119714:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929971.119718:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cdb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119736:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cdb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119749:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929971.119752:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929971.119757:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cdb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119763:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cdb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119778:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119784:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119790:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119795:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929971.119797:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119803:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119810:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e83038700) 00010000:00010000:0.0:1788929971.119812:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929971.119815:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119832:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119877:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210268 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119892:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cdc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210268 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.119899:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788929971.119901:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929971.119904:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9e00, rc 0) 00000100:00100000:0.0:1788929971.120019:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+50:10420:x1875828747047168:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1012us (1292us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788929971.120027:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:3.0:1788929971.138031:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929971.138071:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.138152:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747047296 00000100:00100000:0.0:1788929971.138163:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747047296 00000100:00100000:0.0:1788929971.138271:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:0.0:1788929971.138283:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+50:10420:x1875828747047296:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:0.0:1788929971.138362:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.138381:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.138393:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.138455:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.138462:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.138469:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.138475:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929971.138479:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.138486:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.138500:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788929971.138503:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788929971.138508:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.138515:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929971.138583:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747047424 00000100:00100000:2.0:1788929971.138589:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747047424 00000100:00100000:0.0:1788929971.138610:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+51:10420:x1875828747047296:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 328us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929971.138618:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:2.0:1788929971.138628:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:2.0:1788929971.138637:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+50:2359:x1875828747047424:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788929971.138648:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929971.138664:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237cdc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210268 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.138685:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:2.0:1788929971.138689:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929971.138715:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+49:2359:x1875828747047424:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 80us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929971.138722:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:2.0:1788929971.146249:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929971.149616:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747047680 00000100:00100000:1.0:1788929971.149635:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747047680 00000100:00100000:1.0:1788929971.149714:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:1.0:1788929971.149725:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+49:10420:x1875828747047680:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:1.0:1788929971.149984:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+50:10420:x1875828747047680:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 260us (3758us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788929971.149992:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:1.0:1788929971.295279:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929971.295417:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747047936 00000100:00100000:2.0:1788929971.295430:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747047936 00000100:00100000:2.0:1788929971.295497:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:2.0:1788929971.295517:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+50:10438:x1875828747047936:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:2.0:1788929971.295549:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929971.295571:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cdd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021026f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.295690:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237cde0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.295705:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237cde0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.295718:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237cde0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929971.295729:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788929971.295861:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cdd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021026f expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.295898:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237cde0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021026f expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.295907:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:2.0:1788929971.295910:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788929971.295914:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341800, rc 0) 00000100:00100000:2.0:1788929971.295980:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:10438:x1875828747047936:12345-192.168.204.40@tcp:101:cat.0 Request processed in 472us (761us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788929971.295986:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:3.0:1788929971.323474:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.323592:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747048064 00000100:00100000:0.0:1788929971.323603:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747048064 00000100:00100000:0.0:1788929971.323665:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:0.0:1788929971.323692:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:10439:x1875828747048064:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929971.323719:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929971.323741:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210276 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.324135:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.324153:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.324166:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929971.324208:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788929971.324212:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929971.324315:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.324350:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237cdee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210276 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.324370:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210276 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.324380:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929971.324383:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788929971.324387:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9600, rc 0) 00000100:00100000:0.0:1788929971.324472:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+53:10439:x1875828747048064:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 783us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929971.324491:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:3.0:1788929971.329469:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929971.329584:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747048448 00000100:00100000:2.0:1788929971.329597:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747048448 00000100:00100000:2.0:1788929971.329666:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:2.0:1788929971.329679:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+53:10439:x1875828747048448:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:2.0:1788929971.330072:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:10439:x1875828747048448:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 395us (613us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788929971.330081:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:1.0:1788929971.338197:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.338278:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747048576 00000100:00100000:0.0:1788929971.338289:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747048576 00000100:00100000:0.0:1788929971.338370:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:0.0:1788929971.338381:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:10439:x1875828747048576:12345-192.168.204.40@tcp:103:lfs.0 00010000:00010000:0.0:1788929971.338399:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788929971.338436:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237cd85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021025a expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.338469:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237cde0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021026f expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.338482:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237cc90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021021b expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.338493:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788929971.338504:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929971.338571:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+51:10439:x1875828747048576:12345-192.168.204.40@tcp:103:lfs.0 Request processed in 192us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929971.338578:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:3.0:1788929971.346925:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929971.347044:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747048704 00000100:00100000:2.0:1788929971.347054:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747048704 00000100:00100000:2.0:1788929971.347121:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 66 00000100:00100000:2.0:1788929971.347133:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+51:10439:x1875828747048704:12345-192.168.204.40@tcp:58:lfs.0 00010000:00010000:2.0:1788929971.351643:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cdfc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.351668:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cdfc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.351700:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cdfc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788929971.352490:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788929971.352739:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788929971.352803:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788929971.353088:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+51:10439:x1875828747048704:12345-192.168.204.40@tcp:58:lfs.0 Request processed in 5952us (6228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929971.353100:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 66 00000100:00100000:3.0:1788929971.386572:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.386750:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747048832 00000100:00100000:0.0:1788929971.386760:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747048832 00000100:00100000:0.0:1788929971.386820:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 67 00000100:00100000:0.0:1788929971.386832:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+51:10441:x1875828747048832:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929971.386859:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929971.386879:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237ce03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021027d expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.386973:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.386988:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.386999:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387012:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387019:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387025:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387102:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237ce18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387110:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237ce18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387115:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237ce18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929971.387147:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788929971.387151:0:11024:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929971.387167:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237ce18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387186:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237ce18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387193:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387199:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387206:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387212:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929971.387216:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387269:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387281:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929971.387284:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929971.387289:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387295:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387307:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387312:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387323:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387328:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929971.387330:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387336:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387343:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e83038500) 00010000:00010000:0.0:1788929971.387346:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929971.387348:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387354:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387386:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237ce03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021027d expref: 53 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387400:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237ce18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021027d expref: 52 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.387417:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e98756100) 00010000:00010000:0.0:1788929971.387419:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788929971.387422:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9000, rc 0) 00000100:00100000:0.0:1788929971.387489:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:10441:x1875828747048832:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 659us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929971.387504:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 67 00000040:00080000:1.0:1788929971.485354:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788929971.485363:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788929971.485428:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788929971.485437:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788929971.485568:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875828770145152:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788929971.485678:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311240 going to sleep for 11 seconds 00000100:00100000:3.0:1788929971.489439:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929971.489616:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747048960 00000100:00100000:2.0:1788929971.489626:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747048960 00000100:00100000:2.0:1788929971.489696:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:2.0:1788929971.489709:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:668b9f78-1e26-4a12-8f20-ad475b3553ba+53:10452:x1875828747048960:12345-192.168.204.40@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788929971.489821:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:668b9f78-1e26-4a12-8f20-ad475b3553ba+53:10452:x1875828747048960:12345-192.168.204.40@tcp:900:lhsmtool_posix.0 Request processed in 113us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929971.489829:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:1.0:1788929971.490705:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875828770145152:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788929971.494119:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.497492:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747049088 00000100:00100000:0.0:1788929971.497509:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747049088 00000100:00100000:0.0:1788929971.497571:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:0.0:1788929971.497649:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:10452:x1875828747049088:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788929971.497735:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788929971.497856:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:10452:x1875828747049088:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 275us (3750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929971.497865:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:0.0:1788929971.504146:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929971.504656:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747049216 00000100:00100000:3.0:1788929971.504666:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747049216 00000100:00100000:2.0:1788929971.504965:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 69 00000100:00100000:2.0:1788929971.504979:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:10452:x1875828747049216:12345-192.168.204.40@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788929971.505096:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237ce1f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505115:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237ce1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505128:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237ce1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505461:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ce26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505471:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ce26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505479:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ce26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505505:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ce2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505514:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ce2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505520:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ce2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929971.505558:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788929971.505562:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788929971.505577:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ce2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505589:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237ce1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505596:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237ce1f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505602:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237ce1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505618:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929971.505622:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237ce1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505630:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237ce1f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505644:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:2.0:1788929971.505647:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929971.505653:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237ce1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505659:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237ce1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505675:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ce26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505680:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ce26 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505686:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ce26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505690:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929971.505693:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ce26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505698:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ce26 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505716:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8d2e98756e00) 00010000:00010000:2.0:1788929971.505718:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929971.505721:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ce26 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505728:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237ce26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505742:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ce2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505749:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ce2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505755:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ce2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505760:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929971.505762:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ce2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.505768:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ce2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.507159:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e98756100) 00010000:00010000:2.0:1788929971.507162:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929971.507168:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ce2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.507176:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237ce2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929971.508264:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:10452:x1875828747049216:12345-192.168.204.40@tcp:34:lhsmtool_posix.0 Request processed in 3273us (4112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929971.508276:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 69 00000100:00100000:1.0:1788929971.529324:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.529565:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747049472 00000100:00100000:0.0:1788929971.529575:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747049472 00000100:00100000:0.0:1788929971.529637:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 70 00000100:00100000:0.0:1788929971.529648:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:10452:x1875828747049472:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788929971.529669:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929971.529691:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210284 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.529799:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.529815:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.529827:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929971.529838:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788929971.529952:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.529960:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.529967:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.529973:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929971.529977:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.529984:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.529995:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e98756100) 00010000:00010000:0.0:1788929971.529998:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788929971.530003:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.530009:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.530044:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce34 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210284 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.530054:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:0.0:1788929971.530056:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788929971.530060:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210284 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.530080:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9200, rc 0) 00000100:00100000:0.0:1788929971.530149:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+53:10452:x1875828747049472:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 502us (836us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788929971.530156:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 70 00000100:00100000:1.0:1788929971.533473:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929971.533875:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747049600 00000100:00100000:3.0:1788929971.533886:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747049600 00000100:00100000:3.0:1788929971.533948:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 71 00000100:00100000:3.0:1788929971.533959:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+53:10452:x1875828747049600:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788929971.534016:0:11024:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788929971.534130:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+53:10452:x1875828747049600:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 172us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929971.534138:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 71 00000100:00100000:1.0:1788929971.538455:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.538552:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747049856 00000100:00100000:0.0:1788929971.538562:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747049856 00000100:00100000:0.0:1788929971.538615:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 72 00000100:00100000:0.0:1788929971.538624:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+53:10452:x1875828747049856:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788929971.538645:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929971.538647:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788929971.538673:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cdf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210276 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.538693:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929971.538697:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788929971.538708:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ce49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021028b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788929971.539079:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788929971.540510:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ce50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.540531:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ce50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.540543:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ce50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.540614:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ce49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021028b expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.540630:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ce50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021028b expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.540638:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788929971.540640:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929971.540643:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9800, rc 0) 00000100:00100000:0.0:1788929971.540716:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:10452:x1875828747049856:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 2092us (2270us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788929971.540725:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 72 00000100:00100000:1.0:1788929971.561495:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.561584:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747050112 00000100:00100000:0.0:1788929971.561594:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747050112 00000100:00100000:0.0:1788929971.561657:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 73 00000100:00100000:0.0:1788929971.561669:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:10452:x1875828747050112:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788929971.561726:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929971.561753:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237ce50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021028b expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.561772:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788929971.561783:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788929971.561806:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ce5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.561819:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ce5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.561837:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ce5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.561866:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ce65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x8600ccb8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.561874:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ce65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8600ccb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.561880:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ce65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8600ccb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.561948:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ce5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.561955:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ce5e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.561962:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ce5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.561969:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929971.561973:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ce5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.561981:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ce5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.561988:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929971.561991:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929971.561995:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ce5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.562010:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ce5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.562020:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ce65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8600ccb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.562026:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ce65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8600ccb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.562031:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ce65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8600ccb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.562035:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929971.562038:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ce65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8600ccb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.562044:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ce65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8600ccb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.562051:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x8600ccb8 (ffff8d2e83038700) 00010000:00010000:0.0:1788929971.562053:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929971.562056:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ce65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8600ccb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.562062:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ce65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8600ccb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929971.562148:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+53:10452:x1875828747050112:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 481us (658us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788929971.562156:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 73 00000100:00100000:1.0:1788929971.565568:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.565645:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747050240 00000100:00100000:0.0:1788929971.565656:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747050240 00000100:00100000:0.0:1788929971.565716:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 74 00000100:00100000:0.0:1788929971.565727:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+53:10452:x1875828747050240:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788929971.565747:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929971.565769:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210292 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.565802:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.565816:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.565828:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.566421:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210292 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.566444:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210292 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.566453:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:0.0:1788929971.566456:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788929971.566460:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8600, rc 0) 00000100:00100000:0.0:1788929971.566515:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:10452:x1875828747050240:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 789us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929971.566522:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 74 00000100:00100000:1.0:1788929971.586508:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.586607:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747050496 00000100:00100000:0.0:1788929971.586616:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747050496 00000100:00100000:0.0:1788929971.586682:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 75 00000100:00100000:0.0:1788929971.586693:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:10452:x1875828747050496:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788929971.586778:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.586795:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.586807:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788929971.587089:0:11024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1788929971.587099:0:11024:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356742874958ns, next at 357742872970ns, rc = 0 00000004:00010000:0.0:1788929971.587184:0:11024:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015eaa4be reply state 00000000d03c3711 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929971.587194:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788929971.587576:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+56:10452:x1875828747050496:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 882us (1076us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788929971.587584:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 75 00000100:00100000:1.0:1788929971.593111:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929971.593212:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747050624 00000100:00100000:3.0:1788929971.593269:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747050624 00000100:00100000:3.0:1788929971.593332:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 76 00000100:00100000:3.0:1788929971.593344:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+56:10452:x1875828747050624:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788929971.593371:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929971.593396:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ce81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210299 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.593473:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ce81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210299 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.593488:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ce81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210299 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.593522:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:3.0:1788929971.593525:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788929971.593529:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597c00, rc 0) 00000100:00100000:3.0:1788929971.593588:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+57:10452:x1875828747050624:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 246us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929971.593595:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 76 00010000:00010000:0.0:1788929971.595369:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.595387:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.595395:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.595430:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929971.595435:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.595442:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.595461:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:0.0:1788929971.595464:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788929971.595469:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.595475:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237ce7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.619131:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929971.623671:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929971.626702:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747050752 00000100:00100000:1.0:1788929971.626719:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747050752 00000100:00100000:1.0:1788929971.626775:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:1.0:1788929971.626785:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875828747050752:12345-192.168.204.40@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788929971.626828:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:1.0:1788929971.626868:0:6687:0:(genops.c:1384:class_connect()) connect: client 668b9f78-1e26-4a12-8f20-ad475b3553ba, cookie 0xce4472dd2237ce88 00002000:00100000:1.0:1788929971.626880:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 668b9f78-1e26-4a12-8f20-ad475b3553ba/ffff8d2d84873000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788929971.626892:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788929971.627142:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788929971.627181:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d2e9adce000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788929971.628672:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2358:x1875828747050752:12345-192.168.204.40@tcp:8:lhsmtool_posix.0 Request processed in 1881us (5008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929971.628684:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:1.0:1788929971.639616:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.639686:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747050880 00000100:00100000:0.0:1788929971.639698:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747050880 00000100:00100000:0.0:1788929971.639774:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 26 00000100:00100000:0.0:1788929971.639786:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:0:x1875828747050880:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788929971.642952:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788929971.704045:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:0:x1875828747050880:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 Request processed in 64250us (64426us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788929971.704060:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 26 00000001:00080000:2.0:1788929971.704098:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1788929971.704109:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 668b9f78-1e26-4a12-8f20-ad475b3553ba 00000100:00100000:1.0:1788929971.706105:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.706254:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747051136 00000100:00100000:0.0:1788929971.706264:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747051136 00000100:00100000:2.0:1788929971.706491:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:2.0:1788929971.706651:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+56:10452:x1875828747051136:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788929971.706950:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+57:10452:x1875828747051136:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 303us (850us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788929971.706958:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:0.0:1788929971.713810:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929971.715071:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747051392 00000100:00100000:3.0:1788929971.715084:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747051392 00000100:00100000:3.0:1788929971.715172:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:3.0:1788929971.715183:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+57:10452:x1875828747051392:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788929971.715355:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+57:10452:x1875828747051392:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 172us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929971.715363:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:0.0:1788929971.722054:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929971.723345:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747051520 00000100:00100000:3.0:1788929971.723358:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747051520 00000100:00100000:3.0:1788929971.723433:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:3.0:1788929971.723443:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+57:10452:x1875828747051520:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788929971.723464:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929971.723485:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237ce8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102a0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.723556:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ce96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.723581:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ce96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.723594:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ce96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929971.723632:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788929971.723653:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ce96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.723680:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237ce8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102a0 expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.723717:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ce96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102a0 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.723725:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:3.0:1788929971.723728:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788929971.723732:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596800, rc 0) 00000100:00100000:3.0:1788929971.723788:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+58:10452:x1875828747051520:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 347us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929971.723795:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:0.0:1788929971.737877:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929971.738210:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747051648 00000100:00100000:1.0:1788929971.738267:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747051648 00000100:00100000:1.0:1788929971.738332:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 27 00000100:00100000:1.0:1788929971.738342:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747051648:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788929971.738362:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929971.738385:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237ce9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102a7 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788929971.738446:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0e7b2, blocks: 0x1 00010000:00010000:1.0:1788929971.738468:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1788929971.738473:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788929971.738483:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237ce9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102a7 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929971.738505:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237ce9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102a7 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929971.738517:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152600, rc 0) 00000100:00100000:1.0:1788929971.738581:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747051648:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 231us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929971.738588:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 27 00000100:00100000:1.0:1788929971.752384:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.752668:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747051904 00000100:00100000:0.0:1788929971.752678:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747051904 00000100:00100000:0.0:1788929971.752731:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00100000:0.0:1788929971.752746:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+58:10452:x1875828747051904:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788929971.753465:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+58:10452:x1875828747051904:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 708us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929971.753475:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00100000:0.0:1788929971.768496:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929971.768688:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747052032 00000100:00100000:2.0:1788929971.768700:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747052032 00000100:00100000:2.0:1788929971.768764:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 28 00000100:00100000:2.0:1788929971.768777:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:10452:x1875828747052032:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788929971.768796:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929971.768813:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979ad954/0xce4472dd2237cea4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102ae expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.768861:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237ce9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102a7 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.768891:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929971.768895:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929971.768901:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979ad954/0xce4472dd2237cea4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ae expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.768935:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237ce9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102a7 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.768952:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237ce9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102a7 expref: 7 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929971.768966:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc82dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1875828770145280:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788929971.769101:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e993e53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929971.773182:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc82dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1875828770145280:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929971.773255:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000979ad954/0xce4472dd2237cea4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ae expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929971.773278:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340200, rc 0) 00000100:00100000:0.0:1788929971.773348:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:10452:x1875828747052032:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 4574us (4863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929971.773358:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 28 00000100:00100000:1.0:1788929971.775054:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929971.775136:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747052160 00000100:00100000:2.0:1788929971.775147:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747052160 00010000:00010000:2.0:1788929971.775193:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237ce9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102a7 expref: 7 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929971.775263:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 42 00000100:00100000:2.0:1788929971.775275:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747052160:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788929971.775291:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929971.775316:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237ce9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102a7 expref: 7 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.775350:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237ce9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102a7 expref: 7 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.775377:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237ce9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102a7 expref: 7 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.775395:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929971.775409:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929971.775418:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000979ad954/0xce4472dd2237cea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ae expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.775431:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979ad954/0xce4472dd2237cea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ae expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.775474:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000979ad954/0xce4472dd2237cea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ae expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929971.775487:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc82dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1875828770145408:192.168.204.40@tcp:105: 00000100:00100000:2.0:1788929971.775567:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e993e5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788929971.779268:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc82dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1875828770145408:192.168.204.40@tcp:105: 00010000:00010000:2.0:1788929971.779299:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929971.779360:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2361:x1875828747052160:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 4086us (4313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929971.779372:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 42 00000100:00100000:0.0:1788929971.786064:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929971.786159:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747052288 00000100:00100000:3.0:1788929971.786169:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747052288 00002000:00100000:3.0:1788929971.786215:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d2ebcb68700 x1875828747052288/t0(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:517/0 lens 504/0 e 0 to 0 dl 1788929982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788929971.786266:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2ebcb68700 with x1875828747052288 ext(0->8) 00002000:00010000:3.0:1788929971.786272:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2ebcb68700 00000100:00100000:3.0:1788929971.786301:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:3.0:1788929971.786311:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2361:x1875828747052288:12345-192.168.204.40@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788929971.786880:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2361:x1875828747052288:12345-192.168.204.40@tcp:4:lhsmtool_posix.0 Request processed in 569us (824us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788929971.786890:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00002000:00100000:3.0:1788929971.786897:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d2ebcb68700 x1875828747052288/t4294967302(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:517/0 lens 504/448 e 0 to 0 dl 1788929982 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788929971.786905:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2ebcb68700 with x1875828747052288 ext(0->8) 00002000:00010000:3.0:1788929971.786915:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2ebcb68700 00000100:00100000:3.0:1788929971.791489:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929971.792005:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747052416 00000100:00100000:0.0:1788929971.792016:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747052416 00000100:00100000:0.0:1788929971.792078:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:0.0:1788929971.792089:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+58:10452:x1875828747052416:12345-192.168.204.40@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788929971.895020:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1788929971.895031:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1788929971.895064:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788929971.895143:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2e89244240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788929971.895149:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2eb5396d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2e89244000 00000020:00080000:2.0:1788929971.895152:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2eb5396600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2e81326c00 00000020:00080000:2.0:1788929971.895456:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788929971.895639:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788929971.895660:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc82f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770145536:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788929971.895725:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929971.895784:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788929971.895791:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc82df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770145664:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788929971.895812:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929971.895993:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770145536 00000100:00100000:2.0:1788929971.896003:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770145536 00000100:00100000:2.0:1788929971.896195:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770145664 00000100:00100000:2.0:1788929971.896199:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770145664 00000100:00080000:1.0:1788929971.896292:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788929971.896486:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788929971.896498:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770145536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788929971.896654:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788929971.896658:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788929970 00002000:00010000:3.0:1788929971.896661:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788929971.896662:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788929970 -> 1788929970 00002000:00010000:3.0:1788929971.896664:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788929971.896721:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875828770145536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (994us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788929971.896728:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788929971.896747:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788929971.896754:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875828770145664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788929971.896769:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788929971.896796:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa0e7b0, atime: 0x6aa0e7b0, ctime: 0x6aa0e7b0, blocks: 0x1 00010000:00010000:3.0:1788929971.896804:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237ceab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.896819:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1788929971.896824:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788929971.896830:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237ceab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.896860:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237ceab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.896889:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237ceab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.896898:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237ceab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929971.896917:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788929971.897387:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2ebc82f800/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788929971.897406:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc82f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770145536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788929971.897835:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875828770145664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1080us (2020us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788929971.897853:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000001:00080000:2.0:1788929971.904423:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00010000:00010000:2.0:1788929971.904473:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788929971.904483:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237ceab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788929971.905152:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2ebc82df80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788929971.905164:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc82df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770145664:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788929971.905376:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788929971.905384:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237ceab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.905408:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237ceab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.905448:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237ceab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.905456:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237ceab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929971.905482:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929971.905483:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929971.905485:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929971.905742:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:10452:x1875828747052416:12345-192.168.204.40@tcp:44:lhsmtool_posix.0 Request processed in 113652us (114261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929971.905762:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:2.0:1788929971.916866:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929971.917036:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747052544 00000100:00100000:3.0:1788929971.917046:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747052544 00000100:00100000:3.0:1788929971.917118:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 31 00000100:00100000:3.0:1788929971.917129:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2360:x1875828747052544:12345-192.168.204.40@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788929972.029816:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1788929972.029833:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1788929972.031484:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747052544:12345-192.168.204.40@tcp:16:lhsmtool_posix.0 Request processed in 114348us (114619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929972.031996:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 31 00000100:00100000:1.0:1788929972.048121:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929972.049167:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747052800 00000100:00100000:1.0:1788929972.049183:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747052800 00000100:00100000:1.0:1788929972.050192:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:1.0:1788929972.050206:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:10452:x1875828747052800:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788929972.050711:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929972.050744:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ce96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102a0 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.050778:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:1.0:1788929972.050783:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788929972.050813:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237ceb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.050827:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237ceb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.050837:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237ceb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788929972.054508:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4918765 reply state 00000000458d0233 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237ceb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929972.054528:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788929972.054686:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:10452:x1875828747052800:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 4480us (6571us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788929972.054695:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 81 00010000:00010000:3.0:1788929972.061823:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237ceb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.062029:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237ceb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.062037:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237ceb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.062049:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929972.062055:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237ceb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.062063:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237ceb2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.062081:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:3.0:1788929972.062085:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929972.062089:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237ceb2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.062095:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237ceb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929972.062745:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929972.063045:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747052928 00000100:00100000:3.0:1788929972.063059:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747052928 00000100:00100000:3.0:1788929972.063125:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 32 00000100:00100000:3.0:1788929972.063136:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2361:x1875828747052928:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788929972.065144:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788929972.065152:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788929970 -> 1788929969 00002000:00010000:3.0:1788929972.065155:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788929968 00002000:00010000:3.0:1788929972.065158:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788929970 -> 1788929969 00002000:00010000:3.0:1788929972.065160:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788929972.067658:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747052928:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 Request processed in 4511us (4906us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788929972.067674:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 32 00000100:00100000:3.0:1788929972.073773:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929972.074095:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747053184 00000100:00100000:0.0:1788929972.074105:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747053184 00000100:00100000:0.0:1788929972.074166:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00100000:0.0:1788929972.074176:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:10452:x1875828747053184:12345-192.168.204.40@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788929972.074270:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.074288:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210292 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.074298:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.074348:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210292 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.074362:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210292 expref: 13 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929972.074375:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770145792:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929972.074472:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e93f00240 going to sleep for 11 seconds 00000100:00100000:3.0:1788929972.083428:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770145792:192.168.204.40@tcp:104: 00010000:00010000:3.0:1788929972.083462:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929972.093031:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929972.093614:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747053312 00000100:00100000:1.0:1788929972.093625:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747053312 00010000:00010000:1.0:1788929972.093671:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210292 expref: 14 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929972.093712:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00100000:1.0:1788929972.093722:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:2362:x1875828747053312:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929972.093737:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929972.093745:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210292 expref: 14 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.093776:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210292 expref: 14 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.093798:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237ce73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210292 expref: 14 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.093815:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:1.0:1788929972.093821:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.093831:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.093839:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.093870:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929972.093934:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:2362:x1875828747053312:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 212us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929972.093942:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 43 00010000:00010000:1.0:1788929972.093969:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.093978:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.094013:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.094030:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.094037:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.094042:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929972.094047:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.094055:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.094064:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:1.0:1788929972.094067:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788929972.094083:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.094090:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237ceb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929972.094130:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+12:10452:x1875828747053184:12345-192.168.204.40@tcp:55:lhsmtool_posix.0 Request processed in 19956us (20367us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788929972.094139:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00100000:2.0:1788929972.103481:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929972.103693:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747053440 00000100:00100000:0.0:1788929972.103703:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747053440 00000100:00100000:0.0:1788929972.103762:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 33 00000100:00100000:0.0:1788929972.103772:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747053440:12345-192.168.204.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788929972.103835:0:6989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.103857:0:6989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000979ad954/0xce4472dd2237cea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ae expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.103866:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788929972.103870:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929972.103874:0:6989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.103909:0:6989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000979ad954/0xce4472dd2237cea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ae expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.103923:0:6989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000979ad954/0xce4472dd2237cea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ae expref: 7 pid: 6685 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929972.103937:0:6989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6989:1875828770145920:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929972.104021:0:6989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e22b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788929972.107427:0:6989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6989:1875828770145920:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788929972.107459:0:6989:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929972.110799:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929972.113101:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747053568 00000100:00100000:1.0:1788929972.113117:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747053568 00010000:00010000:1.0:1788929972.113165:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000979ad954/0xce4472dd2237cea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ae expref: 8 pid: 6685 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929972.113210:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 44 00000100:00100000:1.0:1788929972.113256:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2361:x1875828747053568:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929972.113271:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929972.113291:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000979ad954/0xce4472dd2237cea4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ae expref: 8 pid: 6685 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.113305:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000979ad954/0xce4472dd2237cea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ae expref: 8 pid: 6685 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.113329:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979ad954/0xce4472dd2237cea4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ae expref: 8 pid: 6685 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.113345:0:7629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788929972.113349:0:7629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788929972.113355:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.113365:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.113390:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929972.113460:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747053568:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 204us (2670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929972.113467:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 44 00010000:00010000:1.0:1788929972.113730:0:6989:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.113741:0:6989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.113768:0:6989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.113777:0:6989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.113785:0:6989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.113791:0:6989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788929972.113795:0:6989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.113877:0:6989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.113890:0:6989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.113966:0:6989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237cec0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929972.114035:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2361:x1875828747053440:12345-192.168.204.40@tcp:1:lhsmtool_posix.0 Request processed in 10264us (10565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929972.114043:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 33 00000100:00100000:0.0:1788929972.119012:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929972.120207:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747053824 00000100:00100000:1.0:1788929972.120219:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747053824 00000100:00100000:1.0:1788929972.120653:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:1.0:1788929972.120664:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+12:10452:x1875828747053824:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788929972.120752:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cec7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.120771:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cec7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.120783:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cec7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.121633:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.121650:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ce81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210299 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.121659:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.121692:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ce81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210299 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.121707:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ce81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210299 expref: 13 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929972.121720:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770146048:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929972.121805:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e863116c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788929972.129438:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929972.129512:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747053952 00000100:00100000:0.0:1788929972.129521:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747053952 00010000:00010000:0.0:1788929972.129564:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ce81 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210299 expref: 14 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929972.129619:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 45 00000100:00100000:0.0:1788929972.129629:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:2361:x1875828747053952:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929972.129652:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929972.129661:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ce81 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210299 expref: 14 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.129676:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ce81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210299 expref: 14 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.129699:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:0.0:1788929972.129705:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.129714:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.129721:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.129738:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929972.129799:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:2361:x1875828747053952:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 170us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929972.129806:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 45 00010000:00010000:3.0:1788929972.130572:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237ce81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210299 expref: 13 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929972.130591:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770146048:192.168.204.40@tcp:104: 00010000:00010000:3.0:1788929972.130671:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.130680:0:11024:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.130686:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788929972.131013:0:11024:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788929972.131416:0:11024:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788929972.131464:0:11024:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788929972.131749:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e863ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11024:1875828770146176:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788929972.131807:0:11024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929972.131892:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90277900 going to sleep for 11 seconds 00000100:00100000:1.0:1788929972.132420:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770146176 00000100:00100000:1.0:1788929972.132428:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770146176 00000100:00100000:1.0:1788929972.132536:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788929972.132545:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11024:x1875828770146176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788929972.132642:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11024:x1875828770146176:12345-0@lo:1000:mdt00_003.0 Request processed in 95us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929972.132650:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788929972.132685:0:11024:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788929972.132690:0:11024:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2ebc82f800, transno 4294967303 00000100:00100000:1.0:1788929972.132705:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e863ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11024:1875828770146176:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788929972.133610:0:11024:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788929972.133687:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11024:1875828770146304:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788929972.133738:0:11024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929972.133765:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311900 going to sleep for 11 seconds 00000100:00100000:3.0:1788929972.134259:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770146304 00000100:00100000:3.0:1788929972.134267:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770146304 00000100:00100000:3.0:1788929972.134316:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788929972.134325:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11024:x1875828770146304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788929972.134515:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11024:x1875828770146304:12345-0@lo:1000:mdt00_003.0 Request processed in 190us (776us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788929972.134531:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788929972.134699:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11024:1875828770146304:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788929972.134734:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134744:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134752:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134759:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929972.134764:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134781:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134797:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2e83038800) 00010000:00010000:1.0:1788929972.134799:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788929972.134804:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134810:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237cece lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134908:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cdfc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134915:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cdfc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134921:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cdfc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134925:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929972.134928:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cdfc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134934:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cdfc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134942:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e98756100) 00010000:00010000:1.0:1788929972.134945:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788929972.134948:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cdfc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134965:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237cdfc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.134999:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.135013:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237ce18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021027d expref: 16 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.135023:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.135051:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237ce18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021027d expref: 16 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.135067:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237ce18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021027d expref: 16 pid: 11024 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929972.135152:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770146432:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929972.135309:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e88011480 going to sleep for 11 seconds 00000100:00080000:0.0:1788929972.135783:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788929972.144445:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770146432:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929972.144465:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00010000:3.0:1788929972.144484:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929972.144586:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747054080 00000100:00100000:0.0:1788929972.144594:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747054080 00010000:00010000:0.0:1788929972.144630:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237ce18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021027d expref: 17 pid: 11024 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929972.144697:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 46 00000100:00100000:0.0:1788929972.144707:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+17:2362:x1875828747054080:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929972.144729:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929972.144736:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237ce18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021027d expref: 17 pid: 11024 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.144748:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237ce18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021027d expref: 17 pid: 11024 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.144769:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237ce18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021027d expref: 17 pid: 11024 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.144782:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e98756100) 00010000:00010000:0.0:1788929972.144787:0:7629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.144797:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.144804:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.144835:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929972.144886:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:2362:x1875828747054080:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 180us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929972.144893:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 46 00010000:00010000:1.0:1788929972.144942:0:11024:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.144950:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.144963:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.144982:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.144988:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.144994:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929972.144998:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.145007:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.145017:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e98756100) 00010000:00010000:1.0:1788929972.145021:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929972.145025:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.145031:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237ced5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.145043:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cec7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.145048:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cec7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.145053:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cec7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.145058:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929972.145066:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cec7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.145085:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cec7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.145093:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e98756100) 00010000:00010000:1.0:1788929972.145096:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788929972.145098:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cec7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.145104:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cec7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929972.145453:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:10452:x1875828747053824:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 24789us (26448us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788929972.145463:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 83 00000020:00080000:1.0:1788929972.145467:0:11024:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788929972.145586:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788929972.145590:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788929972.145615:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788929972.145621:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788929972.150779:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929972.152209:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747054336 00000100:00100000:0.0:1788929972.155102:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747054336 00000100:00100000:1.0:1788929972.155700:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:1.0:1788929972.155712:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:10452:x1875828747054336:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788929972.157120:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788929972.157308:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788929972.157361:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cedc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.157377:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cedc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.157467:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cedc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.157479:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cedc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.157485:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cedc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.157545:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cedc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.157661:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788929972.157769:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+17:10452:x1875828747054336:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 2056us (6993us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788929972.157779:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 20 00000020:00080000:1.0:1788929972.157784:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788929972.159174:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788929972.159185:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cedc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929972.159194:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788929972.159199:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cedc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929972.159208:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cedc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929972.159257:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2eb85fdd00) 00010000:00010000:2.0:1788929972.159260:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788929972.159265:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cedc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929972.159272:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237cedc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929972.159293:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929972.159295:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929972.159297:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788929972.468305:0:11991:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788929972.468316:0:11991:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788929972.468360:0:11991:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788929972.468367:0:11991:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788929972.610296:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929972.610340:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747054592 00000100:00100000:2.0:1788929972.610349:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747054592 00000100:00100000:2.0:1788929972.610419:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:2.0:1788929972.610430:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+17:10462:x1875828747054592:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788929972.610454:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929972.610475:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237cee3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929972.610590:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237ceea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929972.610604:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237ceea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929972.610615:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237ceea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929972.610626:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788929972.610752:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237cee3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102b5 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929972.610770:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237ceea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102b5 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929972.610779:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:2.0:1788929972.610782:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788929972.610786:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341c00, rc 0) 00000100:00100000:2.0:1788929972.610841:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:10462:x1875828747054592:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 412us (553us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788929972.610849:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:3.0:1788929972.622461:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929972.630750:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747054720 00000100:00100000:1.0:1788929972.630766:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747054720 00000100:00100000:0.0:1788929972.631106:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 85 00000100:00100000:0.0:1788929972.631119:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:10462:x1875828747054720:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:0.0:1788929972.631215:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cef8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631251:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cef8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631263:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cef8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631279:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ceff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631286:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ceff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631292:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ceff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631538:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cf06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631555:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cf06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631563:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cf06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788929972.631608:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cf06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631620:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cef8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631636:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cef8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631643:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cef8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631650:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929972.631655:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cef8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631663:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cef8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631675:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929972.631678:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929972.631684:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cef8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631690:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237cef8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631704:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ceff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631710:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ceff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631715:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ceff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631720:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929972.631729:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ceff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631736:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ceff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631745:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e83038700) 00010000:00010000:0.0:1788929972.631748:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929972.631751:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ceff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631757:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237ceff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631773:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cf06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631779:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cf06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631784:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cf06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631789:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929972.631791:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cf06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631797:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cf06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631803:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788929972.631806:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929972.631815:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cf06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.631821:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237cf06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929972.631926:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:10462:x1875828747054720:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 809us (9474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929972.631935:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 85 00010000:00010000:0.0:1788929972.638436:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929972.701556:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929972.705449:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747054976 00000100:00100000:3.0:1788929972.705465:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747054976 00000100:00100000:3.0:1788929972.705558:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 86 00000100:00100000:3.0:1788929972.705569:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:10465:x1875828747054976:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788929972.705599:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929972.705621:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102bc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.705693:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.705707:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.705720:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.705735:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.705742:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.705768:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706051:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706397:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706406:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929972.706417:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788929972.706513:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706521:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706528:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706534:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929972.706538:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706546:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706557:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:3.0:1788929972.706560:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929972.706584:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706591:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706603:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706609:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706615:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706621:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929972.706623:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706629:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706636:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e907e4800) 00010000:00010000:3.0:1788929972.706638:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929972.706641:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706647:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706693:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102bc expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706718:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102bc expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.706726:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4300) 00010000:00010000:3.0:1788929972.706728:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788929972.706731:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597800, rc 0) 00000100:00100000:3.0:1788929972.706805:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:10465:x1875828747054976:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1237us (5265us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788929972.706813:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 86 00000100:00100000:3.0:1788929972.712361:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929972.712870:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747055104 00000100:00100000:0.0:1788929972.712883:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747055104 00000100:00100000:0.0:1788929972.712936:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00100000:0.0:1788929972.712947:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:10465:x1875828747055104:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:0.0:1788929972.713012:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cf30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.713032:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cf30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.713046:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cf30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.713073:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cf30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.713080:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cf30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.713086:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cf30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.713099:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929972.713104:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cf30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.713112:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cf30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.713125:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4300) 00010000:00010000:0.0:1788929972.713128:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788929972.713133:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cf30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.713140:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cf30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929972.713246:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:10465:x1875828747055104:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 277us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929972.713254:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00100000:0.0:1788929972.723741:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929972.728461:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747055360 00000100:00100000:1.0:1788929972.728480:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747055360 00000100:00100000:1.0:1788929972.728549:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:1.0:1788929972.728559:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90954850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:10465:x1875828747055360:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:1.0:1788929972.728792:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90954850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:10465:x1875828747055360:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 233us (5059us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788929972.728812:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:1.0:1788929972.829081:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929972.829332:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747055616 00000100:00100000:3.0:1788929972.829342:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747055616 00000100:00100000:3.0:1788929972.829408:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 88 00000100:00100000:3.0:1788929972.829419:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:9993:x1875828747055616:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1788929972.829445:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929972.829468:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cf37 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.829569:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.829942:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102bc expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.829952:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.829997:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102bc expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.830012:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102bc expref: 23 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929972.830027:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875828770146560:192.168.204.40@tcp:104: 00000100:00100000:3.0:1788929972.830118:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90277540 going to sleep for 11 seconds 00000100:00100000:3.0:1788929972.840520:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929972.841788:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875828770146560:192.168.204.40@tcp:104: 00010000:00010000:3.0:1788929972.842333:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929972.843371:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747055744 00000100:00100000:3.0:1788929972.843393:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747055744 00010000:00010000:3.0:1788929972.843435:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102bc expref: 24 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929972.843483:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 47 00000100:00100000:3.0:1788929972.843493:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:2361:x1875828747055744:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929972.843508:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929972.843515:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102bc expref: 24 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.843528:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102bc expref: 24 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.843582:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102bc expref: 24 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.843596:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4300) 00010000:00010000:3.0:1788929972.843601:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.843611:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.843619:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.843646:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929972.843714:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:2361:x1875828747055744:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 222us (3204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929972.843721:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 47 00010000:00010000:3.0:1788929972.843744:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.843751:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929972.843770:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788929972.850925:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cf37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102c3 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.850952:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102c3 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.850984:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4300) 00010000:00010000:3.0:1788929972.850987:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788929972.850991:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597c00, rc 0) 00000100:00100000:3.0:1788929972.851058:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:9993:x1875828747055616:12345-192.168.204.40@tcp:101:bash.0 Request processed in 21639us (21986us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788929972.851068:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 88 00000100:00100000:3.0:1788929972.861757:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929972.866367:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747056000 00000100:00100000:0.0:1788929972.866395:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747056000 00000100:00100000:1.0:1788929972.866554:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 89 00000100:00100000:1.0:1788929972.866565:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:9993:x1875828747056000:12345-192.168.204.40@tcp:36:bash.0 00010000:00010000:1.0:1788929972.866925:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237cf4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.866942:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237cf4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.867155:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237cf4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788929972.867213:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788929972.867391:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e751b24 reply state 00000000b4a643ee transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237cf4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929972.867401:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788929972.867456:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788929972.867592:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:9993:x1875828747056000:12345-192.168.204.40@tcp:36:bash.0 Request processed in 1026us (5843us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788929972.867601:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 89 00000020:00080000:1.0:1788929972.867606:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788929972.870589:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237cf4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.870609:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237cf4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.870618:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237cf4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.870625:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929972.870645:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237cf4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.870653:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237cf4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.870671:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4300) 00010000:00010000:0.0:1788929972.870674:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929972.870679:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237cf4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.870685:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237cf4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929972.870748:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929972.870919:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747056128 00000100:00100000:1.0:1788929972.870930:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747056128 00000100:00100000:3.0:1788929972.871097:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 90 00000100:00100000:3.0:1788929972.871110:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:9993:x1875828747056128:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1788929972.871133:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929972.871151:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102ca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.871209:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ca expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.871258:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ca expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.871276:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4300) 00010000:00010000:3.0:1788929972.871279:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788929972.871282:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597400, rc 0) 00000100:00100000:3.0:1788929972.871345:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:9993:x1875828747056128:12345-192.168.204.40@tcp:101:bash.0 Request processed in 239us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929972.871352:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 90 00000100:00100000:3.0:1788929972.876182:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929972.876305:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747056256 00000100:00100000:0.0:1788929972.876317:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747056256 00000100:00100000:0.0:1788929972.876375:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 34 00000100:00100000:0.0:1788929972.876396:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:9993:x1875828747056256:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:0.0:1788929972.876419:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929972.876444:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237cf5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102d1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788929972.876470:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa0e7b1, atime: 0x6aa0e7b0, ctime: 0x6aa0e7b1, blocks: 0xb 00010000:00010000:0.0:1788929972.876493:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1788929972.876498:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929972.876506:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237cf5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102d1 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.876525:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237cf5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102d1 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.876558:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9200, rc 0) 00000100:00100000:0.0:1788929972.877124:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:9993:x1875828747056256:12345-192.168.204.40@tcp:101:bash.0 Request processed in 727us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929972.877132:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 34 00000100:00100000:0.0:1788929972.880577:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929972.880661:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747056384 00000100:00100000:3.0:1788929972.880672:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747056384 00002000:00010000:3.0:1788929972.880720:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788929972.880724:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2ebcb69c00 with x1875828747056384 ext(0->18446744073709551615) 00002000:00010000:3.0:1788929972.880735:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2ebcb69c00. 00000100:00100000:3.0:1788929972.880854:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:3.0:1788929972.880866:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2362:x1875828747056384:12345-192.168.204.40@tcp:10:bash.0 00002000:00010000:3.0:1788929972.881284:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788929972.881288:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788929969 -> 1788929971 00002000:00010000:3.0:1788929972.881291:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788929968 -> 1788929968 00002000:00010000:3.0:1788929972.881293:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788929969 -> 1788929971 00002000:00010000:3.0:1788929972.881295:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788929972.881366:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2362:x1875828747056384:12345-192.168.204.40@tcp:10:bash.0 Request processed in 502us (798us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788929972.881375:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1 00002000:00010000:3.0:1788929972.881391:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788929972.881394:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2ebcb69c00 with x1875828747056384 ext(0->18446744073709551615) 00002000:00010000:3.0:1788929972.881398:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2ebcb69c00. 00000100:00100000:2.0:1788929972.941823:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929972.941898:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747056512 00000100:00100000:3.0:1788929972.941908:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747056512 00000100:00100000:3.0:1788929972.942134:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 91 00000100:00100000:3.0:1788929972.942145:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:10479:x1875828747056512:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:3.0:1788929972.942220:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cf61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942276:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cf61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942309:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cf61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942327:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942334:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942341:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942575:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942584:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942590:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788929972.942629:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942639:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cf61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942645:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cf61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942652:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cf61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942669:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929972.942673:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cf61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942680:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cf61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942692:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:3.0:1788929972.942695:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929972.942699:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cf61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942705:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cf61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942717:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942722:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942728:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942733:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929972.942735:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942741:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942760:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e907e4800) 00010000:00010000:3.0:1788929972.942762:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929972.942765:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942771:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cf68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942785:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942791:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942808:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942814:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929972.942816:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942822:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942829:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4300) 00010000:00010000:3.0:1788929972.942831:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929972.942833:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929972.942839:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cf6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929972.942920:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:10479:x1875828747056512:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 775us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929972.942927:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 91 00000100:00100000:1.0:1788929972.984338:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929972.984555:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747056768 00000100:00100000:0.0:1788929972.984567:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747056768 00000100:00100000:0.0:1788929972.984633:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 92 00000100:00100000:0.0:1788929972.984643:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:10482:x1875828747056768:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929972.984663:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929972.984684:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cf76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102d8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.984756:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cf7d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.984770:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cf7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.984781:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cf7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.984795:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cf84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.984814:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.984847:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985342:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cf8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985353:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cf8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985360:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cf8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929972.985369:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788929972.985478:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cf7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985486:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cf7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985493:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cf7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985499:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929972.985503:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cf7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985510:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cf7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985522:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929972.985525:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929972.985538:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cf7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985544:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cf7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985558:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985565:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cf84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985570:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cf84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985576:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929972.985579:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cf84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985584:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cf84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985591:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e83038200) 00010000:00010000:0.0:1788929972.985594:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929972.985597:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cf84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985603:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cf84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985645:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cf76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102d8 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985670:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cf8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102d8 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929972.985678:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4300) 00010000:00010000:0.0:1788929972.985680:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788929972.985682:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8200, rc 0) 00000100:00100000:0.0:1788929972.985751:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:10482:x1875828747056768:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1109us (1422us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788929972.985758:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 92 00000100:00100000:0.0:1788929972.990541:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929972.990639:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747056896 00000100:00100000:1.0:1788929972.990651:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747056896 00000100:00100000:1.0:1788929972.990723:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 93 00000100:00100000:1.0:1788929972.990751:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:10482:x1875828747056896:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:1.0:1788929972.990857:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.990878:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102c3 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.990888:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.990930:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102c3 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929972.990944:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102c3 expref: 29 pid: 5840 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929972.991088:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875828770146688:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929972.991206:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788929972.994307:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929972.994525:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747057152 00000100:00100000:2.0:1788929972.994534:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747057152 00000100:00100000:2.0:1788929972.994590:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00100000:2.0:1788929972.994600:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+30:5598:x1875828747057152:12345-192.168.204.40@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788929972.995076:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:5598:x1875828747057152:12345-192.168.204.40@tcp:35:ldlm_bl.0 Request processed in 476us (777us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788929972.995084:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00100000:1.0:1788929972.995293:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875828770146688:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929972.995318:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929973.000347:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929973.000681:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747057280 00000100:00100000:3.0:1788929973.000693:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747057280 00010000:00010000:3.0:1788929973.000816:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102c3 expref: 31 pid: 5840 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929973.000870:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00100000:3.0:1788929973.000882:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:2361:x1875828747057280:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929973.000902:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929973.000910:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102c3 expref: 31 pid: 5840 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.000925:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102c3 expref: 31 pid: 5840 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.000949:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cf3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102c3 expref: 31 pid: 5840 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.001440:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4300) 00010000:00010000:3.0:1788929973.001446:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.001456:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.001481:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.001514:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788929973.001658:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.001668:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.001714:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.001729:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.001736:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.001743:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929973.001749:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.001758:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.001769:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4300) 00010000:00010000:1.0:1788929973.001772:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788929973.001776:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.001782:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237cf99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929973.001866:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+30:2361:x1875828747057280:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 983us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929973.001875:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00080000:0.0:1788929973.002446:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929973.002561:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:10482:x1875828747056896:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 11810us (12032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929973.002571:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 93 00000100:00100000:0.0:1788929973.005472:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929973.005575:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747057536 00000100:00100000:2.0:1788929973.005585:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747057536 00000100:00100000:2.0:1788929973.005669:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:2.0:1788929973.005680:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:10482:x1875828747057536:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:2.0:1788929973.005924:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+30:10482:x1875828747057536:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 246us (461us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788929973.005939:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:2.0:1788929973.147173:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929973.147275:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747057792 00000100:00100000:0.0:1788929973.147286:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747057792 00000100:00100000:0.0:1788929973.147357:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 94 00000100:00100000:0.0:1788929973.147368:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+30:10493:x1875828747057792:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:0.0:1788929973.147403:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929973.147426:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cfa0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102df expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.147502:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cfa7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.147517:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cfa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.147528:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cfa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.147554:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cfae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.147562:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cfae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.147569:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cfae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.147860:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cfb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.147870:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.147877:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929973.147886:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788929973.147980:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cfa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.147988:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cfa7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.147994:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cfa7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148000:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929973.148005:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cfa7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148022:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cfa7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148035:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929973.148038:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929973.148043:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cfa7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148050:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237cfa7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148064:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cfae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148070:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cfae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148075:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cfae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148080:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929973.148082:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cfae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148088:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cfae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148095:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e83038200) 00010000:00010000:0.0:1788929973.148097:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929973.148100:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cfae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148116:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237cfae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148160:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237cfa0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102df expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148174:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cfb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102df expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.148183:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4300) 00010000:00010000:0.0:1788929973.148185:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929973.148188:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9600, rc 0) 00000100:00100000:0.0:1788929973.148315:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:10493:x1875828747057792:12345-192.168.204.40@tcp:101:cat.0 Request processed in 949us (1151us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788929973.148322:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 94 00000100:00100000:1.0:1788929973.153827:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929973.153971:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747058048 00000100:00100000:0.0:1788929973.153981:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747058048 00000100:00100000:0.0:1788929973.154047:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00100000:0.0:1788929973.154059:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:10493:x1875828747058048:12345-192.168.204.40@tcp:35:cat.0 00000100:00100000:0.0:1788929973.154349:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+33:10493:x1875828747058048:12345-192.168.204.40@tcp:35:cat.0 Request processed in 292us (543us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788929973.154357:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00100000:2.0:1788929973.187012:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929973.187113:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747058304 00000100:00100000:3.0:1788929973.187123:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747058304 00000100:00100000:3.0:1788929973.187195:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 95 00000100:00100000:3.0:1788929973.187206:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+33:10494:x1875828747058304:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:3.0:1788929973.187302:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788929973.187333:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237cfb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102df expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.187360:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237cf8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102d8 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.187386:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cf53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ca expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.187398:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4300) 00010000:00010000:3.0:1788929973.187415:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788929973.187439:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cfc3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.187454:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cfc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.187479:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cfc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.187497:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cfca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.187505:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cfca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.187512:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cfca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.187772:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfd1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.187781:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.187788:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788929973.188425:0:11024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788929973.188437:0:11024:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358344212919ns, next at 359344209930ns, rc = 0 00010000:00010000:3.0:1788929973.188496:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cfd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.188505:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cfd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.188514:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cfd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.188532:0:11024:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cfd8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.188538:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cfd8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.188544:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cfd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189069:0:11024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788929973.189098:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189105:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfd1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189110:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189116:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929973.189120:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189127:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfd1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189139:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4e00) 00010000:00010000:3.0:1788929973.189142:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788929973.189146:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfd1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189163:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfd1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189195:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cfc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189202:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cfc3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189207:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cfc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189211:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929973.189923:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cfc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189930:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cfc3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189941:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:3.0:1788929973.189943:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929973.189946:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cfc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.189952:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cfc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788929973.189963:0:11024:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c7e4edc reply state 000000006d2201cb transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cfca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929973.189972:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788929973.190075:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:10494:x1875828747058304:12345-192.168.204.40@tcp:36:rm.0 Request processed in 2861us (3065us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788929973.190085:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 95 00010000:00010000:0.0:1788929973.191585:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788929973.191597:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cfd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.191607:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788929973.191623:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cfd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.191631:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cfd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.191645:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2e907e4e00) 00010000:00010000:0.0:1788929973.191648:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788929973.191651:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cfd8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.191657:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237cfd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.191677:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929973.191679:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929973.191681:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929973.192964:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cfca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.192979:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cfca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.192987:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cfca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.192992:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929973.192997:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cfca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.193002:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cfca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.193028:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e907e4800) 00010000:00010000:0.0:1788929973.193031:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929973.193035:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cfca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.193041:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cfca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929973.211683:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770147200:0@lo:400:kworker.0 00000100:00100000:2.0:1788929973.211758:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929973.211841:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788929973.211847:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770147072:0@lo:400:kworker.0 00000100:00100000:2.0:1788929973.211875:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929973.211907:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770147200 00000100:00100000:2.0:1788929973.211914:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770147200 00000100:00100000:2.0:1788929973.211959:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788929973.211967:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875828770147200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929973.212014:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875828770147200:12345-0@lo:400:kworker.0 Request processed in 47us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929973.212021:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788929973.212066:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770147200:0@lo:400:kworker.0 00000100:00100000:2.0:1788929973.212089:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770147072 00000100:00100000:2.0:1788929973.212092:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770147072 00000100:00100000:2.0:1788929973.212122:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788929973.212128:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770147072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929973.212163:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770147072:12345-0@lo:400:kworker.0 Request processed in 34us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929973.212169:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1788929973.212184:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788929973.212201:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770147072:0@lo:400:kworker.0 00000100:00100000:0.0:1788929973.212438:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770146944:0@lo:400:kworker.0 00000100:00100000:0.0:1788929973.212472:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929973.212499:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770147456:0@lo:400:kworker.0 00000100:00100000:0.0:1788929973.212518:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929973.212545:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788929973.212550:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770146816:0@lo:400:kworker.0 00000100:00100000:0.0:1788929973.212577:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929973.212598:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770147328:0@lo:400:kworker.0 00000100:00100000:0.0:1788929973.212618:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929973.212642:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770147456 00000100:00100000:0.0:1788929973.212646:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770147456 00000100:00100000:0.0:1788929973.212679:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788929973.212685:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875828770147456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929973.212721:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875828770147456:12345-0@lo:400:kworker.0 Request processed in 36us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929973.212726:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788929973.212745:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770146816 00000100:00100000:0.0:1788929973.212748:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770146816 00000100:00100000:0.0:1788929973.212777:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788929973.212784:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3311:x1875828770146816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929973.212829:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3311:x1875828770146816:12345-0@lo:400:kworker.0 Request processed in 32us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929973.212836:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:0.0:1788929973.212861:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788929973.212877:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770146816:0@lo:400:kworker.0 00000100:00100000:0.0:1788929973.212887:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770147456:0@lo:400:kworker.0 00000100:00100000:3.0:1788929973.213019:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770146944 00000100:00100000:3.0:1788929973.213023:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770146944 00000100:00100000:3.0:1788929973.213060:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770147328 00000100:00100000:3.0:1788929973.213063:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770147328 00000100:00100000:3.0:1788929973.213087:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788929973.213093:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770146944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929973.213131:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770146944:12345-0@lo:400:kworker.0 Request processed in 38us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929973.213137:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788929973.213149:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788929973.213155:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770147328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929973.213180:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770147328:12345-0@lo:400:kworker.0 Request processed in 26us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929973.213185:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1788929973.213198:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929973.213326:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770147328:0@lo:400:kworker.0 00000100:00100000:0.0:1788929973.213337:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770146944:0@lo:400:kworker.0 00000100:00100000:2.0:1788929973.284595:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929973.284732:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747058560 00000100:00100000:3.0:1788929973.284746:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747058560 00000100:00100000:3.0:1788929973.284835:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 96 00000100:00100000:3.0:1788929973.284848:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:10500:x1875828747058560:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1788929973.284879:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929973.284908:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cfdf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102e6 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.285053:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfe6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.285096:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfe6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.285112:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfe6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.285132:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cfed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.285138:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cfed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.285146:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cfed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788929973.285852:0:11024:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788929973.286028:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cff4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.286038:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.286047:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.286083:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfe6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.286089:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfe6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.286096:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfe6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.286108:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929973.286113:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfe6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.286121:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfe6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.286137:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:3.0:1788929973.286140:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929973.286145:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfe6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.286152:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237cfe6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788929973.286167:0:11024:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042f8fcc5 reply state 0000000044b9687f transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cfed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929973.286177:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788929973.286217:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237cfdf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102e6 expref: 34 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.286300:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102e6 expref: 33 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.286308:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e907e4b00) 00010000:00010000:3.0:1788929973.286311:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788929973.286313:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597600, rc 0) 00000100:00100000:3.0:1788929973.286414:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:10500:x1875828747058560:12345-192.168.204.40@tcp:101:bash.0 Request processed in 1569us (1833us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788929973.286429:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 96 00010000:00010000:0.0:1788929973.290141:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cfed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.290165:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cfed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.290174:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cfed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.290182:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929973.290187:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cfed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.290195:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cfed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.290214:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e907e4300) 00010000:00010000:0.0:1788929973.290264:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929973.290271:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cfed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.290277:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237cfed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929973.293709:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929973.293956:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747058688 00000100:00100000:3.0:1788929973.293967:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747058688 00000100:00100000:3.0:1788929973.294054:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 35 00000100:00100000:3.0:1788929973.294068:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2359:x1875828747058688:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1788929973.294086:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929973.294106:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d002 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102ed expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788929973.294135:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788929973.294158:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1788929973.294162:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788929973.294173:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d002 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ed expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.294192:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d002 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ed expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.294205:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597800, rc 0) 00000100:00100000:3.0:1788929973.294304:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2359:x1875828747058688:12345-192.168.204.40@tcp:101:bash.0 Request processed in 239us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929973.294311:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 35 00000100:00080000:0.0:1788929973.294769:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788929973.300427:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929973.300588:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747058816 00000100:00100000:1.0:1788929973.300599:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747058816 00000100:00100000:1.0:1788929973.300666:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 36 00000100:00100000:1.0:1788929973.300677:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:10500:x1875828747058816:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1788929973.300717:0:6989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929973.300738:0:6989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102f4 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.300773:0:6989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d002 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ed expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.300783:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788929973.300788:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788929973.300793:0:6989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 9 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.300844:0:6989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d002 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ed expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.300859:0:6989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d002 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ed expref: 9 pid: 6688 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929973.300875:0:6989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6989:1875828770147584:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929973.300970:0:6989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788929973.304524:0:6989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6989:1875828770147584:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929973.304564:0:6989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 9 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.304584:0:6989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153c00, rc 0) 00000100:00100000:1.0:1788929973.304664:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:10500:x1875828747058816:12345-192.168.204.40@tcp:101:bash.0 Request processed in 3988us (4247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929973.304672:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 36 00000100:00100000:0.0:1788929973.306714:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929973.306796:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747058944 00000100:00100000:3.0:1788929973.306806:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747058944 00010000:00010000:3.0:1788929973.306854:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d002 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ed expref: 9 pid: 6688 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929973.306905:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 49 00000100:00100000:3.0:1788929973.306915:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2361:x1875828747058944:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929973.306929:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929973.306952:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d002 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ed expref: 9 pid: 6688 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.306966:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d002 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ed expref: 9 pid: 6688 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.306989:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d002 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102ed expref: 9 pid: 6688 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.307005:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788929973.307009:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788929973.307017:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 8 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.307027:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 8 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.307066:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 8 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929973.307080:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1875828770147712:192.168.204.40@tcp:105: 00000100:00100000:3.0:1788929973.307164:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90277300 going to sleep for 11 seconds 00000100:00100000:3.0:1788929973.311843:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929973.311962:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747059200 00000100:00100000:1.0:1788929973.311973:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747059200 00000100:00100000:1.0:1788929973.312029:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:1.0:1788929973.312039:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+33:10500:x1875828747059200:12345-192.168.204.40@tcp:35:bash.0 00000100:00100000:1.0:1788929973.312430:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:10500:x1875828747059200:12345-192.168.204.40@tcp:35:bash.0 Request processed in 392us (598us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788929973.312437:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:0.0:1788929973.312533:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1875828770147712:192.168.204.40@tcp:105: 00010000:00010000:0.0:1788929973.312555:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929973.312579:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2361:x1875828747058944:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 5666us (5872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929973.312588:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 49 00000100:00100000:2.0:1788929973.523579:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929973.523690:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747059328 00000100:00100000:1.0:1788929973.523702:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747059328 00000100:00100000:1.0:1788929973.523767:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 97 00000100:00100000:1.0:1788929973.523779:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:10516:x1875828747059328:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788929973.523803:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929973.523833:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402102fb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.523901:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d017 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.523916:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.523929:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929973.523965:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788929973.523981:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788929973.524004:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.524032:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102fb expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.524052:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102fb expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.524061:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:1.0:1788929973.524064:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788929973.524068:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152e00, rc 0) 00000100:00100000:1.0:1788929973.524128:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:10516:x1875828747059328:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 351us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929973.524135:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 97 00000100:00100000:3.0:1788929973.528474:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929973.531990:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747059584 00000100:00100000:0.0:1788929973.532010:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747059584 00000100:00100000:0.0:1788929973.532168:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 98 00000100:00100000:0.0:1788929973.532181:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:10516:x1875828747059584:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929973.532218:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929973.532263:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d01e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210302 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.532394:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d025 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.532409:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.532420:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929973.532448:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788929973.532577:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d01e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210302 expref: 38 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.532600:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210302 expref: 37 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.532609:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e907e4b00) 00010000:00010000:0.0:1788929973.532611:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929973.532615:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8e00, rc 0) 00000100:00100000:0.0:1788929973.532684:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:10516:x1875828747059584:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 505us (4223us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788929973.532691:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 98 00000100:00100000:3.0:1788929973.537287:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929973.537329:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929973.537437:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747059840 00000100:00100000:1.0:1788929973.537447:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747059840 00000100:00100000:1.0:1788929973.537509:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 99 00000100:00100000:1.0:1788929973.537520:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:10516:x1875828747059840:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788929973.537547:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929973.537567:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d033 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210309 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.537673:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d03a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.537687:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d03a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.537720:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d03a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929973.537733:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788929973.537873:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d033 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210309 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.537891:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d03a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210309 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.537899:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e907e4b00) 00010000:00010000:1.0:1788929973.537902:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788929973.537906:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153800, rc 0) 00000100:00100000:1.0:1788929973.537972:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+39:10516:x1875828747059840:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 453us (694us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788929973.537980:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 99 00000100:00100000:0.0:1788929973.538114:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747059968 00000100:00100000:0.0:1788929973.538119:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747059968 00000100:00100000:0.0:1788929973.538168:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:0.0:1788929973.538177:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+39:2360:x1875828747059968:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929973.538187:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929973.538202:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d025 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210302 expref: 39 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.538214:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e907e4b00) 00010000:00010000:0.0:1788929973.538217:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929973.538263:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:2360:x1875828747059968:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 87us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929973.538270:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:1.0:1788929973.551562:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929973.551713:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747060096 00000100:00100000:3.0:1788929973.551724:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747060096 00000100:00100000:3.0:1788929973.551784:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 37 00000100:00100000:3.0:1788929973.551794:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2361:x1875828747060096:12345-192.168.204.40@tcp:1:lfs.0 00010000:00010000:3.0:1788929973.551839:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.551868:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 8 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.551877:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788929973.551881:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788929973.551886:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.551923:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 8 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.551937:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 8 pid: 6989 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929973.551953:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90317480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1875828770147840:192.168.204.40@tcp:104: 00000100:00100000:3.0:1788929973.552075:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90277240 going to sleep for 11 seconds 00000100:00100000:2.0:1788929973.565792:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90317480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1875828770147840:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788929973.565838:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929973.566864:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929973.567097:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747060224 00000100:00100000:3.0:1788929973.567106:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747060224 00002000:00100000:3.0:1788929973.567158:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d2e9837ea00 x1875828747060224/t0(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:519/0 lens 504/0 e 0 to 0 dl 1788929984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788929973.567168:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2e9837ea00 with x1875828747060224 ext(0->8) 00010000:00010000:3.0:1788929973.567178:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 9 pid: 6989 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.567193:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 9 pid: 6989 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788929973.567201:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d2e9837ea00 00000100:00100000:3.0:1788929973.567269:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:3.0:1788929973.567279:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2362:x1875828747060224:12345-192.168.204.40@tcp:4:lfs.0 00000100:00100000:3.0:1788929973.567879:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+11:2362:x1875828747060224:12345-192.168.204.40@tcp:4:lfs.0 Request processed in 599us (1026us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788929973.567888:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1 00002000:00100000:3.0:1788929973.567896:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d2e9837ea00 x1875828747060224/t4294967302(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:519/0 lens 504/448 e 0 to 0 dl 1788929984 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788929973.567905:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2e9837ea00 with x1875828747060224 ext(0->8) 00010000:00010000:3.0:1788929973.567911:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 11 pid: 6989 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.567923:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 11 pid: 6989 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788929973.567936:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d2e9837ea00 00000100:00100000:3.0:1788929973.570695:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929973.575503:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747060352 00000100:00100000:1.0:1788929973.575520:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747060352 00010000:00010000:1.0:1788929973.575577:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 11 pid: 6989 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929973.575630:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 50 00000100:00100000:1.0:1788929973.575640:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+11:2359:x1875828747060352:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929973.575657:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788929973.575690:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788929973.575693:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788929972 00002000:00010000:1.0:1788929973.575696:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788929972 00002000:00010000:1.0:1788929973.575698:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788929972 00010000:00010000:1.0:1788929973.575705:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 11 pid: 6989 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.575719:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 11 pid: 6989 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.575743:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000811c9ade/0xce4472dd2237d009 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102f4 expref: 11 pid: 6989 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.575762:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788929973.575766:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788929973.575771:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.575781:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.575831:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929973.576125:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:2359:x1875828747060352:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 485us (5439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929973.576133:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 50 00010000:00010000:2.0:1788929973.576256:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.576267:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.576290:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.576299:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.576307:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.576314:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788929973.576319:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.576340:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.576352:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.576360:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b3e049f/0xce4472dd2237d048 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929973.576418:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2361:x1875828747060096:12345-192.168.204.40@tcp:1:lfs.0 Request processed in 24625us (24866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929973.576427:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 37 00000100:00100000:0.0:1788929973.587159:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929973.587265:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747060608 00000100:00100000:1.0:1788929973.587275:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747060608 00000100:00100000:1.0:1788929973.587346:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 26 00000100:00100000:1.0:1788929973.587356:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90955850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:10516:x1875828747060608:12345-192.168.204.40@tcp:35:lfs.0 00000004:00010000:1.0:1788929973.587433:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d03a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210309 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788929973.587712:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788929973.587760:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788929973.591800:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788929973.593472:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.593499:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cff4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102e6 expref: 42 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.593508:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.593551:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102e6 expref: 42 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.593568:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cff4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102e6 expref: 42 pid: 11024 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929973.593593:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875828770147968:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929973.593691:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311300 going to sleep for 11 seconds 00000100:00100000:3.0:1788929973.605569:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929973.605971:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747060736 00000100:00100000:0.0:1788929973.605983:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747060736 00010000:00010000:0.0:1788929973.606028:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cff4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102e6 expref: 43 pid: 11024 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929973.606082:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 51 00000100:00100000:0.0:1788929973.606093:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+43:2361:x1875828747060736:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929973.606109:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929973.606116:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cff4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102e6 expref: 43 pid: 11024 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.606130:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cff4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102e6 expref: 43 pid: 11024 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.606153:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e907e4b00) 00010000:00010000:0.0:1788929973.606159:0:7629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.606169:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.606177:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929973.606196:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929973.606313:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+43:2361:x1875828747060736:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 221us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929973.606321:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 51 00010000:00010000:1.0:1788929973.607355:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237cff4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102e6 expref: 42 pid: 11024 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929973.607386:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5842:1875828770147968:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929973.607415:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.607423:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.607429:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788929973.607550:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788929973.607768:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788929973.610850:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875828770148096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788929973.610922:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929973.610964:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311900 going to sleep for 11 seconds 00000100:00100000:0.0:1788929973.611171:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770148096 00000100:00100000:0.0:1788929973.611179:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770148096 00000100:00100000:0.0:1788929973.611262:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788929973.611272:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1875828770148096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788929973.611376:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1875828770148096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929973.611383:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788929973.612289:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875828770148096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788929973.612783:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788929973.613084:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875828770148224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788929973.613130:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929973.613152:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e890773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929973.613253:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770148224 00000100:00100000:0.0:1788929973.613260:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770148224 00000100:00100000:0.0:1788929973.613296:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788929973.613304:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1875828770148224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788929973.613463:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5842:x1875828770148224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 159us (332us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788929973.613471:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788929973.613789:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e33480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5842:1875828770148224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788929973.613846:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788929973.613887:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.613898:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.613918:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.613925:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929973.613930:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.613937:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.613953:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e907e4b00) 00010000:00010000:2.0:1788929973.613956:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788929973.613961:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.613968:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d04f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788929973.614461:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788929973.614554:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788929973.614565:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358770340677ns, next at 359770338806ns, rc = 0 00000001:00080000:2.0:1788929973.614571:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788929973.614693:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e907e4b00) 00010000:00010000:2.0:1788929973.614696:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788929973.614704:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d03a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210309 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929973.614863:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90955850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+45:10516:x1875828747060608:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 27495us (27700us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788929973.614882:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 26 00000020:00080000:2.0:1788929973.614886:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788929973.628467:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929973.628562:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747060864 00000100:00100000:2.0:1788929973.628572:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747060864 00000100:00100000:2.0:1788929973.628632:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 100 00000100:00100000:2.0:1788929973.628643:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+45:10516:x1875828747060864:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788929973.628668:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929973.628693:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237d056 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210310 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.628756:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237d056 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210310 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.628771:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237d056 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210310 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929973.628791:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:2.0:1788929973.628794:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788929973.628798:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340000, rc 0) 00000100:00100000:2.0:1788929973.629026:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+46:10516:x1875828747060864:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 384us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929973.629034:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 100 00000100:00100000:0.0:1788929973.632021:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929973.632281:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747061120 00000100:00100000:2.0:1788929973.632293:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747061120 00000100:00100000:2.0:1788929973.632358:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 27 00000100:00100000:2.0:1788929973.632382:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+46:10516:x1875828747061120:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:2.0:1788929973.632698:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+47:10516:x1875828747061120:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 320us (686us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788929973.632707:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 27 00010000:00010000:2.0:1788929973.659515:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929973.723528:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788929973.723553:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770148352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788929973.723628:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929973.723764:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770148352 00000100:00100000:0.0:1788929973.723773:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770148352 00000100:00100000:0.0:1788929973.723840:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788929973.723851:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3309:x1875828770148352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788929973.723875:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929973.723934:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3309:x1875828770148352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929973.723941:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788929973.724267:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770148352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788929973.748337:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929973.748534:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747061248 00000100:00100000:1.0:1788929973.748544:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747061248 00000100:00100000:1.0:1788929973.748605:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 101 00000100:00100000:1.0:1788929973.748615:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+47:10526:x1875828747061248:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:1.0:1788929973.748692:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d05d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.748711:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d05d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.748724:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d05d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.748738:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d064 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.748746:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.748770:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.748884:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d06b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.748893:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d06b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.748900:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d06b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788929973.748954:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d06b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.748966:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d05d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.748973:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d05d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.748980:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d05d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.748986:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929973.748990:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d05d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.748999:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d05d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749010:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:1.0:1788929973.749019:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929973.749025:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d05d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749031:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d05d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749058:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749064:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d064 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749070:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d064 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749075:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929973.749078:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d064 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749083:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d064 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749090:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2eb85fde00) 00010000:00010000:1.0:1788929973.749093:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929973.749095:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d064 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749100:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d064 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749113:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d06b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749125:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d06b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749130:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d06b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749135:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929973.749138:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d06b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749144:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d06b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749151:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:1.0:1788929973.749153:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929973.749155:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d06b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.749161:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d06b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929973.749289:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+47:10526:x1875828747061248:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 674us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929973.749297:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 101 00000100:00100000:0.0:1788929973.816165:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929973.816266:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747061504 00000100:00100000:3.0:1788929973.816277:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747061504 00000100:00100000:3.0:1788929973.816339:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 102 00000100:00100000:3.0:1788929973.816349:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+47:10530:x1875828747061504:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788929973.816381:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929973.816403:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237d072 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210317 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816477:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d079 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816492:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816504:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816519:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d080 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816544:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816551:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816696:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816704:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816712:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929973.816722:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788929973.816834:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816843:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d079 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816850:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816856:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929973.816860:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816868:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d079 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816891:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:3.0:1788929973.816894:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929973.816900:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d079 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816906:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d079 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816921:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816927:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d080 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816933:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816938:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929973.816941:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816947:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d080 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816954:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e907e4000) 00010000:00010000:3.0:1788929973.816956:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929973.816959:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d080 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.816965:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d080 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.817017:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237d072 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210317 expref: 50 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.817031:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210317 expref: 49 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929973.817038:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:3.0:1788929973.817040:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788929973.817042:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596400, rc 0) 00000100:00100000:3.0:1788929973.817102:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+49:10530:x1875828747061504:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 754us (949us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788929973.817110:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 102 00000100:00100000:0.0:1788929973.823285:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929973.823406:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747061632 00000100:00100000:1.0:1788929973.823417:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747061632 00000100:00100000:1.0:1788929973.823476:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 103 00000100:00100000:1.0:1788929973.823487:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+49:10530:x1875828747061632:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:1.0:1788929973.823559:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d095 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.823595:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.823608:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.823637:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.823658:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d095 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.823665:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.823670:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929973.823675:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.823682:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d095 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.823694:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:1.0:1788929973.823697:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788929973.823702:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d095 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929973.823708:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d095 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929973.823781:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+49:10530:x1875828747061632:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 295us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929973.823794:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 103 00000100:00100000:0.0:1788929973.828910:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929973.829963:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747061888 00000100:00100000:2.0:1788929973.829975:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747061888 00000100:00100000:2.0:1788929973.830049:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 28 00000100:00100000:2.0:1788929973.830061:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+49:10530:x1875828747061888:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:2.0:1788929973.830337:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+50:10530:x1875828747061888:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 278us (1437us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788929973.830345:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 28 00000100:00100000:0.0:1788929974.008668:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929974.008898:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747062144 00000100:00100000:3.0:1788929974.008908:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747062144 00000100:00100000:3.0:1788929974.008967:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 104 00000100:00100000:3.0:1788929974.008976:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+50:10540:x1875828747062144:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1788929974.009000:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929974.009003:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788929974.009034:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d017 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102fb expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.009055:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:3.0:1788929974.009061:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788929974.009075:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237d09c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021031e expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.009188:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d0a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.009213:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.009283:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929974.009295:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788929974.009436:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237d09c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021031e expref: 52 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.009450:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d0a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021031e expref: 51 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.009457:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:3.0:1788929974.009460:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788929974.009462:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596800, rc 0) 00000100:00100000:3.0:1788929974.009512:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+51:10540:x1875828747062144:12345-192.168.204.40@tcp:101:bash.0 Request processed in 537us (856us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788929974.009519:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 104 00000100:00100000:1.0:1788929974.014670:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929974.014903:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747062400 00000100:00100000:2.0:1788929974.014914:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747062400 00000100:00100000:2.0:1788929974.014974:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 105 00000100:00100000:2.0:1788929974.014985:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+51:10540:x1875828747062400:12345-192.168.204.40@tcp:36:bash.0 00010000:00010000:2.0:1788929974.015039:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788929974.015065:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d0a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021031e expref: 51 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.015086:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210317 expref: 50 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.015096:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:2.0:1788929974.015101:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788929974.015340:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d0b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.015384:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.015394:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788929974.015449:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788929974.015473:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097ac210d reply state 00000000d1a56c5d transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929974.015482:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788929974.015563:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:10540:x1875828747062400:12345-192.168.204.40@tcp:36:bash.0 Request processed in 580us (903us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788929974.015571:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 105 00000020:00080000:2.0:1788929974.015576:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788929974.022302:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929974.022405:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747062528 00000100:00100000:1.0:1788929974.022417:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747062528 00000100:00100000:1.0:1788929974.022470:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 106 00000100:00100000:1.0:1788929974.022480:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:10540:x1875828747062528:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1788929974.022506:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929974.022529:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d0b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210325 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929974.022621:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929974.022633:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d0b1 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929974.022654:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929974.022671:0:11024:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929974.022683:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.023951:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.023965:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d0b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.023973:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d0b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.023993:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929974.023997:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d0b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.024005:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d0b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.024021:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:3.0:1788929974.024024:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929974.024027:0:3294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.024035:0:3294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.024043:0:3294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.024093:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d0b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.024101:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d0b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.024194:0:11024:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.024212:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929974.024288:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788929974.024293:0:11024:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788929974.024315:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.024348:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d0b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210325 expref: 53 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.024374:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210325 expref: 52 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.024389:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:2.0:1788929974.024392:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788929974.024394:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152600, rc 0) 00000100:00100000:2.0:1788929974.024467:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:10540:x1875828747062528:12345-192.168.204.40@tcp:101:bash.0 Request processed in 1987us (2174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929974.024476:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 106 00000100:00100000:0.0:1788929974.034498:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929974.034595:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747062784 00000100:00100000:2.0:1788929974.034605:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747062784 00000100:00100000:2.0:1788929974.034673:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 29 00000100:00100000:2.0:1788929974.034684:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:10540:x1875828747062784:12345-192.168.204.40@tcp:35:bash.0 00000100:00100000:2.0:1788929974.034965:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+53:10540:x1875828747062784:12345-192.168.204.40@tcp:35:bash.0 Request processed in 282us (479us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788929974.034973:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 29 00000100:00100000:0.0:1788929974.157824:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929974.157959:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747062912 00000100:00100000:2.0:1788929974.157970:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747062912 00000100:00100000:2.0:1788929974.158036:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 107 00000100:00100000:2.0:1788929974.158046:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+53:10546:x1875828747062912:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788929974.158086:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929974.158108:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d0c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021032c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.158183:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d0cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.158199:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.158253:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929974.158292:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788929974.158295:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788929974.158314:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d0cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.158339:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d0c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021032c expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.158369:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d0cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021032c expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.158377:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:2.0:1788929974.158380:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788929974.158384:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341000, rc 0) 00000100:00100000:2.0:1788929974.158450:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:10546:x1875828747062912:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 406us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929974.158456:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 107 00000100:00100000:1.0:1788929974.161901:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929974.162023:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747063040 00000100:00100000:2.0:1788929974.162035:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747063040 00000100:00100000:2.0:1788929974.162103:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 108 00000100:00100000:2.0:1788929974.162115:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:10546:x1875828747063040:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788929974.162136:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929974.162158:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d0d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210333 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162289:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d0db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162305:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d0db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162318:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d0db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162334:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d0e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162340:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162347:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162449:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162457:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162464:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929974.162501:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788929974.162505:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788929974.162527:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162549:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162558:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d0db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162576:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d0db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162583:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d0db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162589:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929974.162592:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d0db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162600:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d0db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162611:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:2.0:1788929974.162614:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929974.162618:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d0db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162624:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d0db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162636:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162643:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d0e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162658:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162662:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929974.162665:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162670:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d0e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162677:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e98756e00) 00010000:00010000:2.0:1788929974.162679:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929974.162682:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d0e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162686:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d0e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162718:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d0d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210333 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162731:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210333 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.162737:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:2.0:1788929974.162739:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788929974.162742:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340800, rc 0) 00000100:00100000:2.0:1788929974.162807:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:10546:x1875828747063040:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 694us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929974.162823:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 108 00000100:00100000:3.0:1788929974.167472:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929974.170694:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929974.170778:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747063424 00000100:00100000:2.0:1788929974.170789:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747063424 00000100:00100000:2.0:1788929974.170873:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 109 00000100:00100000:2.0:1788929974.170883:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:10546:x1875828747063424:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788929974.170905:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929974.170927:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d0f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021033a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.171029:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.171044:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210325 expref: 56 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.171053:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210333 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.171062:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.171095:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210333 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.171108:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210333 expref: 56 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929974.171123:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e32300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770148480:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788929974.171638:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210325 expref: 56 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.171649:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210325 expref: 56 pid: 11024 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929974.171658:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770148608:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788929974.171686:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89077540 going to sleep for 11 seconds 00000100:00100000:1.0:1788929974.173893:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747063168 00000100:00100000:1.0:1788929974.173908:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747063168 00010000:00010000:1.0:1788929974.173957:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210333 expref: 57 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929974.174010:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 52 00000100:00100000:1.0:1788929974.174021:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+57:2360:x1875828747063168:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929974.174035:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929974.174042:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210333 expref: 57 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929974.174055:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210333 expref: 57 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929974.174078:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:1.0:1788929974.174084:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929974.174093:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929974.174099:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929974.174149:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+57:2360:x1875828747063168:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 129us (6686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929974.174157:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 52 00000100:00100000:3.0:1788929974.179735:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00010000:2.0:1788929974.179874:0:5839:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.40@tcp) returned -22 from blocking AST (req@0000000089fe9b1a x1875828770148480) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210333 expref: 56 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.179896:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d0e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210333 expref: 56 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929974.179916:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e32300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770148480:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788929974.179929:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770148608:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788929974.179951:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:2.0:1788929974.179957:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.179966:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.179976:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929974.180453:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747063552 00000100:00100000:0.0:1788929974.180461:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747063552 00010000:00010000:0.0:1788929974.180504:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210325 expref: 56 pid: 11024 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929974.180546:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 53 00000100:00100000:0.0:1788929974.180620:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86daad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+56:2361:x1875828747063552:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929974.180640:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929974.180646:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210325 expref: 56 pid: 11024 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929974.180659:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210325 expref: 56 pid: 11024 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929974.180680:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d0bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210325 expref: 56 pid: 11024 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929974.180692:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:0.0:1788929974.180696:0:7629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929974.180705:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929974.180731:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929974.180762:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929974.180932:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86daad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:2361:x1875828747063552:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 376us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929974.180940:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 53 00010000:00010000:2.0:1788929974.181151:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.181167:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929974.181185:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788929974.181376:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d0f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021033a expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.181393:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021033a expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.181401:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:2.0:1788929974.181404:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788929974.181406:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340200, rc 0) 00000100:00100000:2.0:1788929974.181436:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:10546:x1875828747063424:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 10554us (10753us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788929974.181443:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 109 00000100:00100000:0.0:1788929974.188555:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929974.190343:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747063808 00000100:00100000:1.0:1788929974.190368:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747063808 00000100:00100000:1.0:1788929974.190453:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:1.0:1788929974.190464:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:10546:x1875828747063808:12345-192.168.204.40@tcp:103:lfs.0 00010000:00010000:1.0:1788929974.190481:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929974.190507:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237d056 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210310 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929974.190543:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:1.0:1788929974.190548:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929974.190620:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:10546:x1875828747063808:12345-192.168.204.40@tcp:103:lfs.0 Request processed in 157us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929974.190627:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:1.0:1788929974.193323:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929974.193417:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747063936 00000100:00100000:2.0:1788929974.193426:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747063936 00000100:00100000:2.0:1788929974.193482:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 110 00000100:00100000:2.0:1788929974.193492:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:10546:x1875828747063936:12345-192.168.204.40@tcp:58:lfs.0 00010000:00010000:2.0:1788929974.193591:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d105 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.193607:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929974.193619:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788929974.193834:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788929974.193906:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:10546:x1875828747063936:12345-192.168.204.40@tcp:58:lfs.0 Request processed in 414us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929974.193914:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 110 00000100:00100000:0.0:1788929974.196017:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929974.196093:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747064064 00000100:00100000:3.0:1788929974.196102:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747064064 00000100:00100000:3.0:1788929974.196154:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 111 00000100:00100000:3.0:1788929974.196164:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:10546:x1875828747064064:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788929974.196206:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929974.196254:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237d10c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210341 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.196315:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d105 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.196326:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237d10c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210341 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.196346:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.196370:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237d10c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210341 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.196387:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:3.0:1788929974.196390:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788929974.196394:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237d10c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210341 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929974.196401:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597c00, rc 0) 00000100:00100000:3.0:1788929974.196456:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:10546:x1875828747064064:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 293us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929974.196463:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 111 00010000:00010000:0.0:1788929974.683585:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788929975.195567:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788929975.195576:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788929975.195627:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788929975.195635:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788929975.195788:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875828770148736:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788929975.195907:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89077540 going to sleep for 11 seconds 00000100:00100000:2.0:1788929975.202688:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875828770148736:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788929975.203363:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929975.203441:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747064192 00000100:00100000:2.0:1788929975.203449:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747064192 00000100:00100000:2.0:1788929975.203523:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 112 00000100:00100000:2.0:1788929975.203533:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:10547:x1875828747064192:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788929975.203566:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788929975.203679:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:10547:x1875828747064192:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 147us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929975.203686:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 112 00000100:00080000:0.0:1788929975.204440:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929975.209603:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929975.209813:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747064320 00000100:00100000:3.0:1788929975.209833:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747064320 00000100:00100000:3.0:1788929975.209900:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 113 00000100:00100000:3.0:1788929975.209925:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:10547:x1875828747064320:12345-192.168.204.40@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788929975.210003:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d113 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210021:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d113 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210037:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d113 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210096:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d11a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210105:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d11a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210112:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d11a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210133:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210141:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210148:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929975.210187:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788929975.210191:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788929975.210202:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210260:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d113 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210268:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d113 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210276:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d113 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210282:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929975.210286:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d113 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210294:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d113 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210307:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:3.0:1788929975.210310:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929975.210316:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d113 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210322:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d113 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210347:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d11a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210355:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d11a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210361:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d11a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210373:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929975.210382:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d11a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210389:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d11a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210397:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8d2e907e4000) 00010000:00010000:3.0:1788929975.210399:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929975.210402:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d11a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210407:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d11a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210422:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210428:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d121 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210433:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210437:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929975.210440:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210445:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210462:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:3.0:1788929975.210464:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929975.210467:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d121 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.210472:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929975.211372:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:10547:x1875828747064320:12345-192.168.204.40@tcp:34:lhsmtool_posix.0 Request processed in 1442us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929975.211384:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 113 00000100:00100000:3.0:1788929975.216674:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929975.216744:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747064576 00000100:00100000:2.0:1788929975.216755:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747064576 00000100:00100000:2.0:1788929975.216814:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 114 00000100:00100000:2.0:1788929975.216824:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:10547:x1875828747064576:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788929975.216844:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929975.216878:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d128 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210348 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.216975:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d12f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.216990:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d12f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.217003:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d12f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929975.217013:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788929975.217101:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d12f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.217109:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d12f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.217117:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d12f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.217122:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929975.217126:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d12f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.217134:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d12f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.217145:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:2.0:1788929975.217148:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788929975.217153:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d12f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.217169:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d12f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.217215:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d128 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210348 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.217266:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:2.0:1788929975.217269:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788929975.217275:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d128 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210348 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.217286:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340800, rc 0) 00000100:00100000:2.0:1788929975.217431:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+56:10547:x1875828747064576:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 608us (771us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788929975.217437:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 114 00000100:00100000:1.0:1788929975.221728:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929975.222653:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747064704 00000100:00100000:0.0:1788929975.222665:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747064704 00000100:00100000:0.0:1788929975.222738:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 115 00000100:00100000:0.0:1788929975.222750:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+56:10547:x1875828747064704:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788929975.223002:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788929975.223157:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+56:10547:x1875828747064704:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 409us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929975.223166:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 115 00000100:00100000:0.0:1788929975.233163:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929975.233323:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747064960 00000100:00100000:1.0:1788929975.233343:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747064960 00000100:00100000:1.0:1788929975.233415:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 116 00000100:00100000:1.0:1788929975.233426:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+56:10547:x1875828747064960:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788929975.233450:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929975.233465:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788929975.233495:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d0cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021032c expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.233514:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:1.0:1788929975.233519:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788929975.233532:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d13d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021034f expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788929975.234158:0:11024:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788929975.234428:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d144 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.234920:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.234934:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.235005:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d13d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021034f expref: 58 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.235023:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021034f expref: 57 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.235030:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2eb85fde00) 00010000:00010000:1.0:1788929975.235033:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788929975.235036:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153c00, rc 0) 00000100:00100000:1.0:1788929975.236182:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+57:10547:x1875828747064960:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 2751us (3023us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788929975.236192:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 116 00000100:00100000:0.0:1788929975.241705:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929975.241951:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747065216 00000100:00100000:3.0:1788929975.241963:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747065216 00000100:00100000:3.0:1788929975.242024:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 117 00000100:00100000:3.0:1788929975.242034:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+57:10547:x1875828747065216:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788929975.242123:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929975.242150:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d144 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021034f expref: 57 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242171:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2eb85fde00) 00010000:00010000:3.0:1788929975.242181:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788929975.242202:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d152 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242262:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d152 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242284:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d152 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242300:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d159 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe8307f54 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242307:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe8307f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242314:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe8307f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242391:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d152 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242400:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d152 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242406:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d152 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242412:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929975.242418:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d152 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242426:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d152 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242435:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:3.0:1788929975.242438:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929975.242442:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d152 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242457:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d152 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242467:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe8307f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242473:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d159 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe8307f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242479:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe8307f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242484:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929975.242487:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe8307f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.242494:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d159 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe8307f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.260351:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe8307f54 (ffff8d2e907e4000) 00010000:00010000:3.0:1788929975.260356:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929975.260365:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d159 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe8307f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.260501:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d159 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe8307f54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929975.261943:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+56:10547:x1875828747065216:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 19902us (20240us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788929975.261955:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 117 00000004:00080000:0.0:1788929975.270411:0:6714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360426184343ns, next at 361426181894ns, rc = 0 00000100:00100000:2.0:1788929975.270473:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788929975.270507:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770148864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788929975.270588:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929975.270817:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770148864 00000100:00100000:0.0:1788929975.270827:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770148864 00000100:00100000:0.0:1788929975.270888:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788929975.270898:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875828770148864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788929975.270948:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929975.270998:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875828770148864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929975.271005:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788929975.271025:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788929975.271065:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770148864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788929975.274285:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929975.274372:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747065344 00000100:00100000:2.0:1788929975.274382:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747065344 00000100:00100000:2.0:1788929975.274441:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 118 00000100:00100000:2.0:1788929975.274451:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+56:10547:x1875828747065344:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788929975.274470:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929975.274493:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d160 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210356 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.274548:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.274563:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.274574:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.274666:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210356 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.274683:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210356 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.274692:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2e98756e00) 00010000:00010000:2.0:1788929975.274695:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788929975.274699:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341600, rc 0) 00000100:00100000:2.0:1788929975.274753:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+57:10547:x1875828747065344:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 303us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929975.274760:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 118 00000100:00100000:2.0:1788929975.280697:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929975.280740:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747065600 00000100:00100000:2.0:1788929975.280750:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747065600 00000100:00100000:2.0:1788929975.280811:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 119 00000100:00100000:2.0:1788929975.280821:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+57:10547:x1875828747065600:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788929975.280912:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d16e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.280940:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d16e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.280953:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d16e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788929975.287054:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1788929975.287310:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089fe9b1a reply state 000000007c6b7a92 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d16e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929975.287322:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788929975.291775:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+59:10547:x1875828747065600:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 10944us (11081us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788929975.291799:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 119 00010000:00010000:1.0:1788929975.300351:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d16e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.300368:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d16e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.300377:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d16e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.300383:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929975.300400:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d16e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.300409:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d16e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.300427:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2e98756e00) 00010000:00010000:1.0:1788929975.300430:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788929975.300435:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d16e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.300441:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d16e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929975.308560:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929975.308644:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747065728 00000100:00100000:0.0:1788929975.308659:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747065728 00000100:00100000:0.0:1788929975.308718:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 120 00000100:00100000:0.0:1788929975.308729:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+58:10547:x1875828747065728:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788929975.308751:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929975.308772:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d175 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021035d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.308845:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021035d expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.308860:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021035d expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.308877:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2e98756e00) 00010000:00010000:0.0:1788929975.308880:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788929975.308884:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9600, rc 0) 00000100:00100000:0.0:1788929975.308943:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+59:10547:x1875828747065728:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 216us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929975.308950:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 120 00000100:00100000:1.0:1788929975.315165:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929975.315275:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747065856 00000100:00100000:2.0:1788929975.315285:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747065856 00000100:00100000:2.0:1788929975.315381:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 38 00000100:00100000:2.0:1788929975.315393:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2362:x1875828747065856:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788929975.316064:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788929975.316438:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2362:x1875828747065856:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 Request processed in 1043us (1279us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788929975.316449:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 38 00000100:00100000:3.0:1788929975.321911:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929975.322698:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747066112 00000100:00100000:2.0:1788929975.322725:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747066112 00000100:00100000:2.0:1788929975.322793:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 30 00000100:00100000:2.0:1788929975.322804:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+59:10547:x1875828747066112:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788929975.323494:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+60:10547:x1875828747066112:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 688us (1590us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788929975.323520:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 30 00000100:00100000:2.0:1788929975.331645:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929975.331954:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747066368 00000100:00100000:3.0:1788929975.331965:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747066368 00000100:00100000:3.0:1788929975.332200:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 121 00000100:00100000:3.0:1788929975.332214:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+60:10547:x1875828747066368:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788929975.332364:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+60:10547:x1875828747066368:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 153us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929975.332372:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 121 00000001:00080000:2.0:1788929975.340809:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1788929975.341050:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1788929975.341291:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1788929975.342410:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929975.342504:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747066496 00000100:00100000:1.0:1788929975.342514:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747066496 00000100:00100000:1.0:1788929975.342575:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 122 00000100:00100000:1.0:1788929975.342587:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+60:10547:x1875828747066496:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788929975.342608:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929975.342629:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d17c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210364 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.342708:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d183 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.342723:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.342735:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929975.342772:0:11024:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788929975.342790:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.342815:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d17c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210364 expref: 62 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.342831:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210364 expref: 61 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.342913:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2e98756e00) 00010000:00010000:1.0:1788929975.342916:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788929975.342920:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153800, rc 0) 00000100:00100000:1.0:1788929975.342971:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:10547:x1875828747066496:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 387us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929975.342978:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 122 00000100:00100000:3.0:1788929975.346151:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929975.346365:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747066624 00000100:00100000:1.0:1788929975.346379:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747066624 00000100:00100000:1.0:1788929975.346598:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:1.0:1788929975.346610:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2361:x1875828747066624:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788929975.346633:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929975.346657:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237d18a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021036b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788929975.346694:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0e7b6, blocks: 0x1 00010000:00010000:1.0:1788929975.346715:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:1.0:1788929975.346734:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788929975.346743:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237d18a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021036b expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.346765:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237d18a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021036b expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.346777:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152600, rc 0) 00000100:00100000:1.0:1788929975.346858:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:2361:x1875828747066624:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 251us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929975.346865:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:2.0:1788929975.349991:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929975.350075:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747066880 00000100:00100000:0.0:1788929975.350087:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747066880 00000100:00100000:0.0:1788929975.350147:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 123 00000100:00100000:0.0:1788929975.350157:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:10547:x1875828747066880:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788929975.350505:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:10547:x1875828747066880:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 348us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929975.350513:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 123 00000100:00100000:3.0:1788929975.354090:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929975.354370:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747067008 00000100:00100000:1.0:1788929975.354382:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747067008 00000100:00100000:1.0:1788929975.354509:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:1.0:1788929975.354521:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:10547:x1875828747067008:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788929975.354541:0:6989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929975.354560:0:6989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237d191 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210372 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.354595:0:6989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237d18a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021036b expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.354605:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788929975.354610:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788929975.354615:0:6989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237d191 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210372 expref: 11 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.354756:0:6989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237d18a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021036b expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.354771:0:6989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237d18a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021036b expref: 11 pid: 6685 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929975.354849:0:6989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb536a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6989:1875828770148992:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929975.355200:0:6989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e88011480 going to sleep for 11 seconds 00000100:00100000:3.0:1788929975.358069:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929975.358159:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747067136 00000100:00100000:0.0:1788929975.358172:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747067136 00010000:00010000:0.0:1788929975.358362:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237d18a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021036b expref: 12 pid: 6685 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929975.358405:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 54 00000100:00100000:0.0:1788929975.358415:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+12:2361:x1875828747067136:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929975.358433:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929975.358463:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237d18a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021036b expref: 12 pid: 6685 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.358479:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237d18a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021036b expref: 12 pid: 6685 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.358625:0:7629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929975.358630:0:7629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929975.358640:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237d191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210372 expref: 12 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.358671:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237d191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210372 expref: 12 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.358711:0:7629:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237d191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210372 expref: 12 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929975.358724:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7629:1875828770149120:192.168.204.40@tcp:105: 00000100:00100000:0.0:1788929975.358837:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebc00 going to sleep for 11 seconds 00010000:00010000:1.0:1788929975.359069:0:6989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237d18a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021036b expref: 12 pid: 6685 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929975.359088:0:6989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb536a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6989:1875828770148992:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929975.359110:0:6989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237d191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210372 expref: 11 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.359120:0:6989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152400, rc 0) 00000100:00100000:1.0:1788929975.359157:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+11:10547:x1875828747067008:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 4637us (5075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929975.359164:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:0.0:1788929975.362753:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7629:1875828770149120:192.168.204.40@tcp:105: 00010000:00010000:0.0:1788929975.362792:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929975.362853:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:2361:x1875828747067136:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 4439us (4793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929975.362864:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 54 00000100:00100000:3.0:1788929975.365147:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929975.365394:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747067264 00000100:00100000:0.0:1788929975.365405:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747067264 00002000:00100000:0.0:1788929975.365457:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d2d85550000 x1875828747067264/t0(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:521/0 lens 504/0 e 0 to 0 dl 1788929986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788929975.365470:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2d85550000 with x1875828747067264 ext(0->12) 00002000:00010000:0.0:1788929975.365475:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2d85550000 00000100:00100000:0.0:1788929975.365615:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:0.0:1788929975.365629:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:2362:x1875828747067264:12345-192.168.204.40@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788929975.366085:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+12:2362:x1875828747067264:12345-192.168.204.40@tcp:4:lhsmtool_posix.0 Request processed in 458us (945us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788929975.366101:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2 00002000:00100000:0.0:1788929975.366109:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d2d85550000 x1875828747067264/t4294967308(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:521/0 lens 504/448 e 0 to 0 dl 1788929986 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788929975.366117:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2d85550000 with x1875828747067264 ext(0->12) 00002000:00010000:0.0:1788929975.366121:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2d85550000 00000100:00100000:3.0:1788929975.368566:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929975.368710:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747067392 00000100:00100000:0.0:1788929975.368721:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747067392 00000100:00100000:0.0:1788929975.368791:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 124 00000100:00100000:0.0:1788929975.368802:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:10547:x1875828747067392:12345-192.168.204.40@tcp:44:lhsmtool_posix.0 00000004:00080000:3.0:1788929975.400935:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:3.0:1788929975.400969:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967378 is committed 00000001:00080000:3.0:1788929975.401134:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000100:00100000:2.0:1788929975.401156:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00080000:3.0:1788929975.401174:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2e86311cc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788929975.401179:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2e902f9c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2e86311540 00000020:00080000:3.0:1788929975.401182:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2e902f9400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2e81326400 00000001:00080000:3.0:1788929975.401199:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788929975.401218:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788929975.401257:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2e89077cc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788929975.401261:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2e86435c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2e89077600 00000020:00080000:3.0:1788929975.401264:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2e86435600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2e881ad400 00000020:00080000:3.0:1788929975.401288:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1788929975.401302:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788929975.401684:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:10547:x1875828747067392:12345-192.168.204.40@tcp:44:lhsmtool_posix.0 Request processed in 32879us (33123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929975.401694:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 124 00000100:00100000:2.0:1788929975.402099:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770149248:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788929975.402150:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788929975.402194:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788929975.402427:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788929975.402657:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770149248 00000100:00100000:3.0:1788929975.402665:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770149248 00000100:00100000:3.0:1788929975.402837:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788929975.402848:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875828770149248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788929975.402875:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1788929975.402904:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.402936:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237cf5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102d1 expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.402945:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788929975.402948:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788929975.402953:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.402980:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237cf5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102d1 expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.402995:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237cf5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102d1 expref: 11 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929975.403496:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9ae1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875828770149504:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929975.403639:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770149376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788929975.403916:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929975.403981:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770149376 00000100:00100000:2.0:1788929975.403988:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770149376 00000100:00100000:2.0:1788929975.404045:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788929975.404054:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770149376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788929975.404072:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1788929975.404102:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa0e7b4, atime: 0x6aa0e7b4, ctime: 0x6aa0e7b4, blocks: 0xb 00010000:00010000:2.0:1788929975.404108:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237d19f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.404122:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1788929975.404125:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929975.404131:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237d19f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.404147:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237d19f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.404178:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237d19f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.404186:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237d19f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.404203:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788929975.404996:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90277300 going to sleep for 11 seconds 00000100:00100000:3.0:1788929975.405545:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929975.405628:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788929975.405634:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875828770149376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1580us (1716us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788929975.405637:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788929975.405643:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788929975.405663:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747067520 00000100:00100000:2.0:1788929975.405791:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747067520 00000100:00100000:2.0:1788929975.405821:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00100000:2.0:1788929975.405830:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+12:2359:x1875828747067520:12345-192.168.204.40@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1788929975.405885:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788929975.405903:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788929975.405910:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237d19f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.405922:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788929975.405926:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237d19f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.405936:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237d19f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.405968:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237d19f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.405976:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237d19f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.405996:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929975.405998:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929975.405999:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929975.406324:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788929975.406341:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1788929975.406361:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2ebc82df80, transno 4294967301 00000004:00080000:0.0:1788929975.406405:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1788929975.406420:0:3311:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d2eb5e31500 x1875828770149376/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788929991 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788929975.406439:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2eb5e31500/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788929975.406814:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770149376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788929975.411843:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929975.411910:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747067648 00000100:00100000:1.0:1788929975.411919:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747067648 00010000:00010000:1.0:1788929975.411963:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237cf5a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102d1 expref: 13 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929975.412017:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 55 00000100:00100000:1.0:1788929975.412028:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:2362:x1875828747067648:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929975.412044:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929975.412051:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237cf5a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102d1 expref: 13 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.412065:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237cf5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102d1 expref: 13 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.412091:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788929975.412097:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788929975.412102:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.412112:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.412132:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929975.412179:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:2362:x1875828747067648:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 152us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929975.412186:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 55 00010000:00010000:3.0:1788929975.412369:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237cf5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.40@tcp remote: 0xa85ca716402102d1 expref: 12 pid: 6687 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929975.412387:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9ae1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875828770149504:192.168.204.40@tcp:104: 00010000:00010000:3.0:1788929975.412411:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.412422:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.412430:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.412439:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.412448:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.412472:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788929975.413466:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788929975.413476:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.413503:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788929975.413517:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.413527:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.413545:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.413552:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d926504f/0xce4472dd2237d198 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.413574:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929975.413576:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929975.413578:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929975.418006:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875828770149248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15151us (15846us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788929975.418019:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1788929975.418075:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2eb5e30000/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788929975.418091:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770149248:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788929975.516371:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+11:2359:x1875828747067520:12345-192.168.204.40@tcp:16:lhsmtool_posix.0 Request processed in 110524us (110812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929975.516385:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 43 00000001:00080000:3.0:1788929975.518160:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1788929975.518386:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1788929975.526760:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929975.526903:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747067904 00000100:00100000:3.0:1788929975.526914:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747067904 00000100:00100000:3.0:1788929975.526987:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 125 00000100:00100000:3.0:1788929975.526999:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:10547:x1875828747067904:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788929975.527138:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929975.527167:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d183 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210364 expref: 15 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.527390:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2e98756e00) 00010000:00010000:3.0:1788929975.527396:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788929975.527433:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d1a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.527447:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d1a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.527457:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d1a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788929975.527706:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004072aac3 reply state 000000008bed8938 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d1a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929975.527717:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788929975.529058:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:10547:x1875828747067904:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 2056us (2302us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788929975.529068:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 125 00010000:00010000:3.0:1788929975.538467:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d1a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929975.538482:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00010000:3.0:1788929975.538486:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d1a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.538493:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d1a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.538500:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929975.538505:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d1a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.538529:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d1a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.538547:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2e98756e00) 00010000:00010000:3.0:1788929975.538550:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929975.538555:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d1a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.538562:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d1a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929975.539506:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747068032 00000100:00100000:0.0:1788929975.539519:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747068032 00000100:00100000:2.0:1788929975.539708:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 44 00000100:00100000:2.0:1788929975.539720:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb536a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747068032:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788929975.539981:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788929975.539985:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788929972 00002000:00010000:2.0:1788929975.539997:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788929972 00002000:00010000:2.0:1788929975.539999:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788929974 -> 1788929972 00002000:00010000:2.0:1788929975.540001:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788929975.540079:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb536a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2362:x1875828747068032:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 Request processed in 361us (1600us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788929975.540093:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 44 00000100:00100000:3.0:1788929975.542678:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929975.542779:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747068288 00000100:00100000:0.0:1788929975.542790:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747068288 00000100:00100000:0.0:1788929975.542856:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 126 00000100:00100000:0.0:1788929975.542866:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:10547:x1875828747068288:12345-192.168.204.40@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788929975.542938:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.542954:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d167 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210356 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.542963:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.542995:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210356 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.543022:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d167 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210356 expref: 15 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929975.543037:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770149632:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929975.543117:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788929975.545740:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929975.545773:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747068416 00000100:00100000:3.0:1788929975.545791:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747068416 00010000:00010000:3.0:1788929975.545837:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d167 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210356 expref: 16 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929975.545872:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 56 00000100:00100000:3.0:1788929975.545881:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:2361:x1875828747068416:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929975.545895:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929975.545901:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d167 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210356 expref: 16 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.545913:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d167 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210356 expref: 16 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.545934:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2e98756e00) 00010000:00010000:3.0:1788929975.545952:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.545961:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.545969:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.545987:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788929975.546129:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d167 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210356 expref: 16 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929975.546148:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770149632:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929975.546166:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.546192:0:11024:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.546198:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.546247:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.546254:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.546270:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.546277:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929975.546281:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.546288:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.546298:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2e98756e00) 00010000:00010000:0.0:1788929975.546301:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788929975.546304:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.546311:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d1ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929975.546505:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:2361:x1875828747068416:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 624us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929975.546513:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 56 00000100:00100000:0.0:1788929975.547526:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:10547:x1875828747068288:12345-192.168.204.40@tcp:55:lhsmtool_posix.0 Request processed in 4655us (4852us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788929975.547549:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 126 00000100:00100000:0.0:1788929975.550053:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929975.550184:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747068544 00000100:00100000:3.0:1788929975.550196:0:12006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747068544 00000100:00100000:3.0:1788929975.550289:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 45 00000100:00100000:3.0:1788929975.550300:0:12006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2359:x1875828747068544:12345-192.168.204.40@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788929975.550357:0:12006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.550378:0:12006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237d191 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210372 expref: 7 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.550388:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788929975.550392:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788929975.550397:0:12006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.550432:0:12006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237d191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210372 expref: 7 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929975.550461:0:12006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237d191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210372 expref: 7 pid: 6989 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929975.550477:0:12006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9ae1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12006:1875828770149760:192.168.204.40@tcp:104: 00000100:00100000:3.0:1788929975.550563:0:12006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90277240 going to sleep for 11 seconds 00000100:00100000:1.0:1788929975.554537:0:12006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9ae1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12006:1875828770149760:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929975.554570:0:12006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929975.554811:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929975.554908:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747068672 00000100:00100000:1.0:1788929975.554916:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747068672 00010000:00010000:1.0:1788929975.554950:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237d191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210372 expref: 8 pid: 6989 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929975.555111:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 57 00000100:00100000:1.0:1788929975.555121:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2362:x1875828747068672:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929975.555137:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929975.555160:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237d191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210372 expref: 8 pid: 6989 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.555177:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237d191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210372 expref: 8 pid: 6989 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.555199:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237d191 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210372 expref: 8 pid: 6989 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.555215:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788929975.555219:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788929975.555478:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.555489:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.555524:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929975.555575:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2362:x1875828747068672:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 454us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929975.555584:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 57 00010000:00010000:0.0:1788929975.555726:0:12006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.555736:0:12006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.555761:0:12006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.555770:0:12006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.555778:0:12006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.555785:0:12006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788929975.555790:0:12006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.555808:0:12006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.555821:0:12006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.555835:0:12006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c8fd90e/0xce4472dd2237d1b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929975.555885:0:12006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2359:x1875828747068544:12345-192.168.204.40@tcp:1:lhsmtool_posix.0 Request processed in 5586us (5842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929975.555893:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 45 00000100:00100000:0.0:1788929975.557878:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929975.558292:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747068928 00000100:00100000:2.0:1788929975.558304:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747068928 00000100:00100000:2.0:1788929975.558557:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 127 00000100:00100000:2.0:1788929975.558569:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:10547:x1875828747068928:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788929975.558648:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d1bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.558666:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d1bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.558679:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d1bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.558927:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.558940:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d175 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021035d expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.558949:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.558983:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021035d expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.559010:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d175 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021035d expref: 15 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929975.559024:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770149888:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788929975.559113:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788929975.561818:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929975.561975:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747069056 00000100:00100000:0.0:1788929975.561983:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747069056 00010000:00010000:0.0:1788929975.562087:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d175 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021035d expref: 16 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929975.562124:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 58 00000100:00100000:0.0:1788929975.562134:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:2362:x1875828747069056:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929975.562149:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929975.562155:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d175 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021035d expref: 16 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.562167:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d175 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021035d expref: 16 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.562197:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2e98756e00) 00010000:00010000:0.0:1788929975.562202:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.562211:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.562271:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.562289:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929975.562345:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:2362:x1875828747069056:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 212us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929975.562352:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 58 00010000:00010000:2.0:1788929975.562591:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d175 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021035d expref: 15 pid: 5840 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929975.562609:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770149888:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788929975.562630:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.562639:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.562645:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788929975.562920:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788929975.563125:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788929975.563170:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788929975.563578:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875828770150016:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788929975.563626:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929975.563761:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311240 going to sleep for 11 seconds 00000100:00100000:3.0:1788929975.564643:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770150016 00000100:00100000:3.0:1788929975.564652:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770150016 00000100:00100000:2.0:1788929975.565478:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788929975.565491:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875828770150016:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788929975.565618:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875828770150016:12345-0@lo:1000:mdt00_000.0 Request processed in 128us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929975.565625:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788929975.565698:0:5839:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788929975.565704:0:5839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:0.0:1788929975.565727:0:5839:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d2eb5e30000 x1875828770149248/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788929991 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929975.565738:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875828770150016:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788929975.566335:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788929975.566408:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875828770150144:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788929975.566445:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929975.566959:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788929975.567059:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770150144 00000100:00100000:1.0:1788929975.567067:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770150144 00000100:00100000:1.0:1788929975.567101:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788929975.567109:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1875828770150144:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788929975.567622:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5839:x1875828770150144:12345-0@lo:1000:mdt00_000.0 Request processed in 512us (1175us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788929975.567630:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788929975.567696:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875828770150144:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788929975.567729:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.567738:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.567745:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.567751:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929975.567767:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.567888:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.567905:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2e98756e00) 00010000:00010000:0.0:1788929975.567908:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788929975.567914:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.567920:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d1c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.567949:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.567955:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d105 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.567961:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d105 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.567966:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929975.567969:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d105 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.567974:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d105 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.567982:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:0.0:1788929975.567984:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788929975.567997:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237d10c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210341 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.568008:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237d10c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210341 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.568080:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237d10c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210341 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.568111:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237d10c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210341 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929975.568125:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770150272:192.168.204.40@tcp:105: 00000100:00100000:0.0:1788929975.568433:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788929975.573436:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770150272:192.168.204.40@tcp:105: 00010000:00010000:2.0:1788929975.573468:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d105 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573479:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d105 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573524:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d1c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573537:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d1c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573548:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d1c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573560:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d1c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573566:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d1c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573572:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d1c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573578:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929975.573581:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d1c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573605:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d1c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573616:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:2.0:1788929975.573619:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929975.573623:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d1c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573628:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d1c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573638:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d1bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573644:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d1bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573650:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d1bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573654:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929975.573657:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d1bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573663:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d1bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573671:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:2.0:1788929975.573673:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788929975.573676:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d1bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929975.573691:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d1bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929975.573931:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:10547:x1875828747068928:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 15363us (16059us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788929975.573942:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 127 00000020:00080000:2.0:1788929975.573948:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788929975.574122:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788929975.574127:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788929975.574678:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788929975.574687:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788929975.575083:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929975.575750:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747069184 00000100:00100000:1.0:1788929975.575761:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747069184 00000100:00100000:1.0:1788929975.575820:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 31 00000100:00100000:1.0:1788929975.575830:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:10546:x1875828747069184:12345-192.168.204.40@tcp:49:lfs.0 00000100:00100000:1.0:1788929975.575944:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:10546:x1875828747069184:12345-192.168.204.40@tcp:49:lfs.0 Request processed in 114us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929975.575951:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 31 00000100:00100000:3.0:1788929975.578865:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929975.578939:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747069440 00000100:00100000:0.0:1788929975.578949:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747069440 00000100:00100000:0.0:1788929975.578997:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 128 00000100:00100000:0.0:1788929975.579005:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:10546:x1875828747069440:12345-192.168.204.40@tcp:58:lfs.0 00000040:00080000:0.0:1788929975.579499:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788929975.579580:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:10546:x1875828747069440:12345-192.168.204.40@tcp:58:lfs.0 Request processed in 575us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929975.579589:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 128 00000100:00100000:0.0:1788929975.580571:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929975.581891:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747069696 00000100:00100000:1.0:1788929975.581904:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747069696 00000100:00100000:1.0:1788929975.581960:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 32 00000100:00100000:1.0:1788929975.581970:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90954450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:10547:x1875828747069696:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788929975.583711:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788929975.584215:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788929975.584316:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d1d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.584344:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d1d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.584366:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d1d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.584375:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d1d0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.584381:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d1d0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.584387:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d1d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.584413:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788929975.584524:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90954450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:10547:x1875828747069696:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 2551us (3953us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788929975.584534:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 32 00000020:00080000:1.0:1788929975.584540:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788929975.586850:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788929975.586862:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d1d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.586873:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152e00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788929975.586893:0:7628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d1d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.586904:0:7628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d1d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.586921:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2eb85fd000) 00010000:00010000:0.0:1788929975.586924:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788929975.586929:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d1d0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.586935:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d1d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.586957:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929975.586959:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929975.586961:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929975.631646:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929975.632552:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747069824 00000100:00100000:0.0:1788929975.632564:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747069824 00000100:00100000:0.0:1788929975.632628:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 129 00000100:00100000:0.0:1788929975.632639:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:10549:x1875828747069824:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929975.632666:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929975.632690:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d1d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210379 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.632760:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.632786:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.632798:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.632827:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d1e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.632835:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.632842:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.633080:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237d1ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.633094:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021033a expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.633102:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237d1ec lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.633138:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021033a expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.633153:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021033a expref: 21 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929975.633166:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875828770150400:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929975.633564:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aeb480 going to sleep for 11 seconds 00000100:00100000:3.0:1788929975.637378:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929975.637712:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875828770150400:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929975.637740:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237d1ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929975.638102:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747070080 00000100:00100000:2.0:1788929975.638112:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747070080 00000100:00100000:2.0:1788929975.638358:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 33 00000100:00100000:2.0:1788929975.638370:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:5598:x1875828747070080:12345-192.168.204.40@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788929975.638680:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:5598:x1875828747070080:12345-192.168.204.40@tcp:35:ldlm_bl.0 Request processed in 312us (1312us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788929975.639906:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 33 00000100:00100000:2.0:1788929975.642154:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929975.642595:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747070208 00000100:00100000:3.0:1788929975.642609:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747070208 00010000:00010000:3.0:1788929975.642665:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021033a expref: 23 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929975.642789:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 59 00000100:00100000:1.0:1788929975.642803:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:2361:x1875828747070208:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929975.642822:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929975.642830:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021033a expref: 23 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.642848:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021033a expref: 23 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.642884:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d0f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021033a expref: 23 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.642928:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:1.0:1788929975.642934:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237d1ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.642944:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237d1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.642953:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237d1ec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929975.643017:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788929975.643083:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237d1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643093:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237d1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929975.643141:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788929975.643146:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929975.643167:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237d1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643263:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237d1ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643275:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643282:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643289:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643295:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929975.643300:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643308:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643317:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:0.0:1788929975.643410:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788929975.643414:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:2361:x1875828747070208:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 615us (1270us total) trans 0 rc 0/0 00010000:00010000:0.0:1788929975.643417:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929975.643422:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 59 00010000:00010000:0.0:1788929975.643423:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643435:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643441:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d1e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643446:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643451:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929975.643454:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643460:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d1e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643468:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2e83038400) 00010000:00010000:0.0:1788929975.643471:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929975.643473:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d1e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643478:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d1e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643510:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d1d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210379 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643536:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237d1ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210379 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929975.643543:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:0.0:1788929975.643546:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929975.643548:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9400, rc 0) 00000100:00100000:0.0:1788929975.643578:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:10549:x1875828747069824:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 10940us (11944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929975.643585:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 129 00010000:00010000:2.0:1788929975.707949:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929975.768019:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929975.768065:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929975.768110:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929975.768144:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747070464 00000100:00100000:2.0:1788929975.768158:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747070464 00000100:00100000:2.0:1788929975.768271:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:2.0:1788929975.768282:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747070464:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929975.768371:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747070464:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929975.768395:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00080000:2.0:1788929975.768418:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788929975.768497:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747070592 00000100:00100000:1.0:1788929975.768502:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747070592 00000100:00100000:1.0:1788929975.768546:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 141 00000100:00100000:1.0:1788929975.768552:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747070592:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929975.768581:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747070592:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 30us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929975.768586:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 141 00000100:00100000:3.0:1788929975.768700:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747070336 00000100:00100000:3.0:1788929975.768705:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747070336 00000100:00100000:3.0:1788929975.768740:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 288 00000100:00100000:3.0:1788929975.768747:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747070336:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929975.768774:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747070336:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 29us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929975.768782:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 288 00000100:00080000:2.0:1788929975.768974:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788929976.307037:0:12045:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788929976.307046:0:12045:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788929976.307119:0:12045:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788929976.307126:0:12045:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788929976.605986:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788929976.605997:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788929976.607606:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788929976.607617:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788929976.607745:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875828770150528:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788929976.607975:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e863116c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929976.614092:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929976.614167:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747070720 00000100:00100000:2.0:1788929976.614177:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747070720 00000100:00100000:2.0:1788929976.614254:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 130 00000100:00100000:2.0:1788929976.614265:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:10562:x1875828747070720:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788929976.614301:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788929976.614436:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:10562:x1875828747070720:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 172us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929976.614443:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 130 00000100:00100000:1.0:1788929976.614498:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875828770150528:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788929976.618914:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929976.619162:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747070976 00000100:00100000:1.0:1788929976.619172:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747070976 00000100:00100000:1.0:1788929976.619276:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 131 00000100:00100000:1.0:1788929976.619287:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:10562:x1875828747070976:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788929976.619339:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929976.619364:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d1f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210380 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929976.619781:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929976.619796:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929976.619809:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929976.619820:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788929976.619949:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d1f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210380 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929976.619983:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210380 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929976.619991:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:0.0:1788929976.619994:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929976.619998:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8600, rc 0) 00000100:00100000:0.0:1788929976.620157:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:10562:x1875828747070976:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 787us (1169us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788929976.620166:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 131 00000100:00100000:3.0:1788929976.626711:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929976.626762:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929976.626916:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747071104 00000100:00100000:0.0:1788929976.626938:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747071104 00000100:00100000:2.0:1788929976.626944:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747071360 00000100:00100000:2.0:1788929976.626948:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747071360 00000100:00100000:2.0:1788929976.627000:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 132 00000100:00100000:0.0:1788929976.627000:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:2.0:1788929976.627010:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:10562:x1875828747071360:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788929976.627010:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88160000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:2360:x1875828747071104:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929976.627027:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929976.627051:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d1fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210380 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929976.627068:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:0.0:1788929976.627073:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788929976.627075:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d208 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929976.627089:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929976.627099:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929976.627145:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88160000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:2360:x1875828747071104:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 136us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929976.627152:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00010000:00010000:2.0:1788929976.627336:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929976.627358:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d208 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929976.627365:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d208 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929976.627371:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929976.627375:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d208 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929976.627383:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d208 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929976.627393:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:2.0:1788929976.627869:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788929976.627878:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d208 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929976.627884:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d208 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929976.628017:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:10562:x1875828747071360:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 1006us (1252us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788929976.628025:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 132 00000040:00080000:1.0:1788929976.628670:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788929976.628676:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788929976.629102:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788929976.629111:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788929976.632293:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929976.633521:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747071616 00000100:00100000:1.0:1788929976.633533:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747071616 00000100:00100000:2.0:1788929976.633622:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 34 00000100:00100000:2.0:1788929976.633635:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:10562:x1875828747071616:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788929976.633877:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:10562:x1875828747071616:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 244us (1595us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788929976.633902:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 34 00010000:00010000:1.0:1788929976.732905:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929977.778086:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929978.331572:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb536b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770151040:0@lo:400:kworker.0 00000100:00100000:1.0:1788929978.331657:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929978.331714:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788929978.331721:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770150912:0@lo:400:kworker.0 00000100:00100000:1.0:1788929978.331748:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929978.331858:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770150784:0@lo:400:kworker.0 00000100:00100000:3.0:1788929978.332093:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770150912 00000100:00100000:3.0:1788929978.332103:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770150912 00000100:00100000:3.0:1788929978.332171:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788929978.332182:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb536ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770150912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929978.332260:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb536ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770150912:12345-0@lo:400:kworker.0 Request processed in 80us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929978.332268:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788929978.332308:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929978.332337:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770151296:0@lo:400:kworker.0 00000100:00100000:3.0:1788929978.332366:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929978.332389:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788929978.332395:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb536a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770150656:0@lo:400:kworker.0 00000100:00100000:3.0:1788929978.332423:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929978.332446:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770151168:0@lo:400:kworker.0 00000100:00100000:3.0:1788929978.332467:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929978.332490:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770150656 00000100:00100000:3.0:1788929978.332494:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770150656 00000100:00100000:3.0:1788929978.332521:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788929978.332527:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770150656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929978.332583:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770150656:12345-0@lo:400:kworker.0 Request processed in 55us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929978.332589:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788929978.332730:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770150784 00000100:00100000:3.0:1788929978.332734:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770150784 00000100:00100000:3.0:1788929978.332760:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770151168 00000100:00100000:3.0:1788929978.332763:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770151168 00000100:00100000:3.0:1788929978.332781:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788929978.332786:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770150784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929978.332889:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770150784:12345-0@lo:400:kworker.0 Request processed in 101us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929978.332895:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788929978.332906:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788929978.332912:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770151168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929978.332938:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770151168:12345-0@lo:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929978.332943:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788929978.333166:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb536a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770150656:0@lo:400:kworker.0 00000100:00100000:3.0:1788929978.333180:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770151168:0@lo:400:kworker.0 00000100:00100000:3.0:1788929978.333190:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770150784:0@lo:400:kworker.0 00000100:00100000:3.0:1788929978.333263:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770150912:0@lo:400:kworker.0 00000100:00080000:1.0:1788929978.333488:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788929978.333578:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770151040 00000100:00100000:2.0:1788929978.333584:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770151040 00000100:00080000:1.0:1788929978.333871:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788929978.333924:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770151296 00000100:00100000:2.0:1788929978.333929:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770151296 00000100:00100000:2.0:1788929978.334042:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788929978.334052:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875828770151040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929978.334114:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875828770151040:12345-0@lo:400:kworker.0 Request processed in 65us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929978.334120:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788929978.334134:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788929978.334139:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875828770151296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788929978.334168:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875828770151296:12345-0@lo:400:kworker.0 Request processed in 29us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929978.334173:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788929978.334216:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb536b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770151040:0@lo:400:kworker.0 00000100:00100000:2.0:1788929978.334305:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770151296:0@lo:400:kworker.0 00000100:00080000:3.0:1788929978.334514:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788929978.667123:0:12096:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788929978.667135:0:12096:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788929978.667180:0:12096:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788929978.667191:0:12096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788929978.781553:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929978.858461:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788929978.858487:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770151424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788929978.858568:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929978.858629:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770151424 00000100:00100000:2.0:1788929978.858637:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770151424 00000100:00100000:2.0:1788929978.858688:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788929978.858698:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875828770151424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788929978.858741:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788929978.858798:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875828770151424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929978.858815:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788929978.859047:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770151424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788929978.892146:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929978.892180:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747071872 00000100:00100000:3.0:1788929978.892190:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747071872 00000100:00100000:3.0:1788929978.892287:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 133 00000100:00100000:3.0:1788929978.892299:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:10582:x1875828747071872:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788929978.892323:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929978.892345:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d20f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210387 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929978.892448:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d216 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929978.892463:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929978.892477:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929978.892489:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788929978.892610:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237d20f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210387 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929978.892627:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d216 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210387 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929978.892635:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:3.0:1788929978.892638:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788929978.892642:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596000, rc 0) 00000100:00100000:3.0:1788929978.892698:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:10582:x1875828747071872:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 403us (560us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788929978.892713:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 133 00000100:00080000:3.0:1788929978.892737:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929978.900027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929978.907374:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747072000 00000100:00100000:0.0:1788929978.907391:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747072000 00000100:00100000:1.0:1788929978.907527:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 134 00000100:00100000:1.0:1788929978.907539:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:10582:x1875828747072000:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:1.0:1788929978.907610:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d224 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929978.907635:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929978.907647:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929978.907674:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929978.907681:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d224 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929978.907688:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d224 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929978.907694:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929978.907699:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d224 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929978.907706:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d224 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929978.907718:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:1.0:1788929978.907722:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788929978.907727:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d224 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929978.907733:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d224 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929978.907809:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:10582:x1875828747072000:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 272us (7790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929978.907822:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 134 00000100:00100000:3.0:1788929979.111683:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929979.111726:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747072128 00000100:00100000:3.0:1788929979.111738:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747072128 00000100:00100000:3.0:1788929979.111807:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 46 00000100:00100000:3.0:1788929979.111818:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747072128:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:3.0:1788929979.111848:0:6989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929979.111874:0:6989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000343707be/0xce4472dd2237d22b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021038e expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788929979.111905:0:6989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa0e7b4, atime: 0x6aa0e7b4, ctime: 0x6aa0e7b4, blocks: 0xb 00010000:00010000:3.0:1788929979.111926:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=364s v=(0 0) 00010000:00010000:3.0:1788929979.111931:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788929979.111942:0:6989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000343707be/0xce4472dd2237d22b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021038e expref: 7 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929979.111962:0:6989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000343707be/0xce4472dd2237d22b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021038e expref: 7 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929979.111974:0:6989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596800, rc 0) 00000100:00100000:3.0:1788929979.112030:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2362:x1875828747072128:12345-192.168.204.40@tcp:101:cat.0 Request processed in 213us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929979.112038:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 46 00000100:00080000:3.0:1788929979.112061:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788929979.124923:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929979.125114:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747072256 00000100:00100000:2.0:1788929979.125125:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747072256 00002000:00100000:2.0:1788929979.125178:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8d2eb536b100 x1875828747072256/t0(0) o3->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:525/0 lens 488/0 e 0 to 0 dl 1788929990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788929979.125190:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2eb536b100 with x1875828747072256 ext(0->4095) 00002000:00010000:2.0:1788929979.125197:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2eb536b100 00000100:00100000:2.0:1788929979.125272:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:2.0:1788929979.125283:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb536b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2360:x1875828747072256:12345-192.168.204.40@tcp:3:cat.0 00000100:00100000:2.0:1788929979.125504:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb536b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2360:x1875828747072256:12345-192.168.204.40@tcp:3:cat.0 Request processed in 222us (603us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788929979.125511:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 3 00002000:00100000:2.0:1788929979.125518:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8d2eb536b100 x1875828747072256/t0(0) o3->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:525/0 lens 488/4536 e 0 to 0 dl 1788929990 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788929979.125526:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2eb536b100 with x1875828747072256 ext(0->4095) 00002000:00010000:2.0:1788929979.125529:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2eb536b100 00010000:00010000:1.0:1788929979.817942:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788929980.379494:0:6714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365535267380ns, next at 366535264693ns, rc = 0 00000100:00100000:1.0:1788929980.379570:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb536aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770151552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788929980.379644:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929980.379714:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770151552 00000100:00100000:1.0:1788929980.379722:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770151552 00000100:00100000:1.0:1788929980.379790:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788929980.379799:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875828770151552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788929980.379830:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929980.379874:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875828770151552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929980.379881:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788929980.380676:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb536aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770151552:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788929980.382297:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788929980.456870:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788929980.466087:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:1.0:1788929980.466108:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2e98aeb3c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788929980.466112:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2eb5396f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2e98aebcc0 00000020:00080000:1.0:1788929980.466116:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2eb5396b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2ebc824800 00000004:00080000:1.0:1788929980.466133:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:1.0:1788929980.466158:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1788929980.466172:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:1.0:1788929980.466182:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1788929980.466190:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000100:00100000:1.0:1788929980.466322:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770151680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788929980.466393:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788929980.466472:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1788929980.466675:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770151680 00000100:00100000:1.0:1788929980.466691:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770151680 00000100:00100000:1.0:1788929980.466760:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788929980.466770:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875828770151680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788929980.466959:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788929980.466963:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788929972 -> 1788929972 00002000:00010000:1.0:1788929980.466965:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1788929972 -> 1788929972 00002000:00010000:1.0:1788929980.466967:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788929972 -> 1788929972 00002000:00010000:1.0:1788929980.466970:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788929980.467018:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1875828770151680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 251us (627us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788929980.467026:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000004:00080000:0.0:1788929980.467200:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2eb5368700/2, rc 0, transno 4294967312 00000100:00100000:0.0:1788929980.467209:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770151680:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788929980.827943:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929980.890019:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929980.890075:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929980.890119:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929980.890146:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929980.890169:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929980.890207:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747072512 00000100:00100000:3.0:1788929980.890219:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747072512 00000100:00100000:1.0:1788929980.890447:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747072384 00000100:00100000:1.0:1788929980.890452:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747072384 00000100:00100000:1.0:1788929980.890493:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 290 00000100:00100000:1.0:1788929980.890504:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747072384:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929980.890613:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747072384:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 110us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929980.890621:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 290 00000100:00100000:2.0:1788929980.891256:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747072640 00000100:00100000:2.0:1788929980.891267:0:12006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747072640 00000100:00100000:2.0:1788929980.891305:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747072768 00000100:00100000:2.0:1788929980.891308:0:12006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747072768 00000100:00100000:2.0:1788929980.891349:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:2.0:1788929980.891358:0:12006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2362:x1875828747072640:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929980.891426:0:12006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2362:x1875828747072640:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 59us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929980.891433:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:2.0:1788929980.891469:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:2.0:1788929980.891475:0:12006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2361:x1875828747072768:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929980.891503:0:12006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2361:x1875828747072768:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929980.891508:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:3.0:1788929980.892215:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747072896 00000100:00100000:3.0:1788929980.892246:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747072896 00000100:00100000:3.0:1788929980.892294:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 145 00000100:00100000:3.0:1788929980.892303:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:2362:x1875828747072512:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929980.892705:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 146 00000100:00100000:1.0:1788929980.892727:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747072896:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929980.892797:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747072896:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 74us (2626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929980.892805:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 146 00000100:00100000:3.0:1788929980.892985:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:2362:x1875828747072512:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 683us (2864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929980.892992:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 145 00000100:00080000:3.0:1788929980.893027:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788929980.893033:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788929981.085547:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1788929981.085569:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000040:00080000:1.0:1788929981.796388:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788929981.796402:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788929981.798192:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788929981.798201:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788929981.854163:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929982.875406:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929983.454429:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770151808:0@lo:400:kworker.0 00000100:00100000:0.0:1788929983.454554:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929983.454753:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770152320:0@lo:400:kworker.0 00000100:00100000:0.0:1788929983.456213:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929983.456304:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788929983.456321:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770152192:0@lo:400:kworker.0 00000100:00100000:0.0:1788929983.456379:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929983.456439:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770151936:0@lo:400:kworker.0 00000100:00100000:0.0:1788929983.456467:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929983.456489:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770152448:0@lo:400:kworker.0 00000100:00100000:0.0:1788929983.456509:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929983.456530:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929983.456536:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770152064:0@lo:400:kworker.0 00000100:00100000:0.0:1788929983.456557:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929983.456596:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770152192 00000100:00100000:0.0:1788929983.456606:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770152192 00000100:00100000:0.0:1788929983.456678:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770152448 00000100:00100000:0.0:1788929983.456682:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770152448 00000100:00100000:0.0:1788929983.456728:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788929983.456738:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770152192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929983.457051:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770152320 00000100:00100000:1.0:1788929983.457057:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770152320 00000100:00100000:1.0:1788929983.457093:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770151936 00000100:00100000:1.0:1788929983.457096:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770151936 00000100:00100000:1.0:1788929983.457110:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770152064 00000100:00100000:1.0:1788929983.457112:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770152064 00000100:00100000:1.0:1788929983.457126:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788929983.457134:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770152320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929983.457217:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770152320:12345-0@lo:400:kworker.0 Request processed in 73us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929983.457252:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788929983.457271:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788929983.457277:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770151936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929983.457307:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770151936:12345-0@lo:400:kworker.0 Request processed in 31us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929983.457314:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788929983.457324:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788929983.457329:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770152064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929983.457355:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770152064:12345-0@lo:400:kworker.0 Request processed in 26us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929983.457361:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788929983.458498:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770152192:12345-0@lo:400:kworker.0 Request processed in 1753us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929983.458513:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788929983.458573:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788929983.458584:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770152448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929983.458635:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770152448:12345-0@lo:400:kworker.0 Request processed in 54us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929983.458641:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788929983.458683:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788929983.463135:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788929983.463140:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788929983.463321:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770152064:0@lo:400:kworker.0 00000100:00100000:0.0:1788929983.463341:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770151936:0@lo:400:kworker.0 00000100:00100000:0.0:1788929983.463354:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788929983.463360:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2eb5e31500, transno 4294967304 00000100:00100000:0.0:1788929983.463377:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770152448:0@lo:400:kworker.0 00000100:00100000:1.0:1788929983.465525:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788929983.465544:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2eb5e30000, transno 4294967309 00000004:00080000:1.0:1788929983.465564:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967312 00000004:00080000:1.0:1788929983.465586:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2eb5368700, transno 4294967312 00000100:00100000:1.0:1788929983.465617:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770152192:0@lo:400:kworker.0 00000100:00100000:1.0:1788929983.465639:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770152320:0@lo:400:kworker.0 00000100:00100000:3.0:1788929983.466974:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770151808 00000100:00100000:3.0:1788929983.466994:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770151808 00000100:00100000:3.0:1788929983.467128:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788929983.467141:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770151808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929983.467307:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770151808:12345-0@lo:400:kworker.0 Request processed in 169us (12754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929983.467315:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788929983.467451:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770151808:0@lo:400:kworker.0 00010000:00010000:1.0:1788929983.900723:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929983.965140:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770152576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788929983.965297:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929983.965557:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770152576 00000100:00100000:0.0:1788929983.965566:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770152576 00000100:00100000:0.0:1788929983.965620:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788929983.965631:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb536b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770152576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788929983.965679:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929983.965735:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb536b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770152576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929983.965742:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788929983.965786:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770152576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788929984.480522:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929984.480789:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747073024 00000100:00100000:1.0:1788929984.480800:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747073024 00000100:00100000:1.0:1788929984.480887:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 135 00000100:00100000:1.0:1788929984.480899:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:10234:x1875828747073024:12345-192.168.204.40@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1788929984.481176:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929984.481301:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:10234:x1875828747073024:12345-192.168.204.40@tcp:60:lhsmtool_posix.0 Request processed in 405us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929984.481310:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 135 00000100:00100000:1.0:1788929984.499622:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929984.500031:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747073280 00000100:00100000:2.0:1788929984.500043:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747073280 00000100:00100000:2.0:1788929984.500107:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 35 00000100:00100000:2.0:1788929984.500118:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb536bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:10234:x1875828747073280:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788929984.500692:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb536bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:10234:x1875828747073280:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 573us (1078us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788929984.500701:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 35 00010000:00010000:2.0:1788929984.924503:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929985.500325:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788929985.500351:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770152704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788929985.500425:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929985.500528:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770152704 00000100:00100000:0.0:1788929985.500537:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770152704 00000100:00100000:0.0:1788929985.500607:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788929985.500617:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770152704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788929985.500669:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788929985.500717:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770152704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929985.500724:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788929985.500749:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788929985.513108:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770152704:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788929985.634022:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1788929985.634049:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788929985.634124:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788929985.634148:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1788929985.948885:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929986.008277:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929986.008314:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929986.008362:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929986.008407:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929986.008462:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929986.008494:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747073792 00000100:00100000:2.0:1788929986.008505:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747073792 00000100:00100000:2.0:1788929986.008567:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747073664 00000100:00100000:2.0:1788929986.008571:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747073664 00000100:00100000:2.0:1788929986.008608:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00100000:2.0:1788929986.008620:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747073792:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929986.008704:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747073792:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 79us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929986.008711:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00100000:2.0:1788929986.008733:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 88 00000100:00100000:2.0:1788929986.008740:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747073664:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929986.008767:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747073664:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929986.008773:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 88 00000100:00100000:2.0:1788929986.008792:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747073536 00000100:00100000:2.0:1788929986.008795:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747073536 00000100:00100000:2.0:1788929986.008818:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747073920 00000100:00100000:2.0:1788929986.008820:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747073920 00000100:00100000:2.0:1788929986.008835:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 150 00000100:00100000:2.0:1788929986.008841:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:2362:x1875828747073536:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929986.008869:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:2362:x1875828747073536:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 28us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929986.008874:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 150 00000100:00100000:2.0:1788929986.008884:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 151 00000100:00100000:2.0:1788929986.008889:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747073920:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929986.008905:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747073920:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 17us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929986.008911:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 151 00000100:00080000:2.0:1788929986.008923:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788929986.008932:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788929986.008934:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788929986.009298:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747073408 00000100:00100000:1.0:1788929986.009304:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747073408 00000100:00100000:1.0:1788929986.009338:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 292 00000100:00100000:1.0:1788929986.009344:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747073408:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929986.009374:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747073408:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 30us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929986.009390:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 292 00000001:02000400:2.0:1788929986.563740:0:12299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:59:43 (1788929983) 00010000:00010000:1.0:1788929986.972321:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929987.995549:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929988.125475:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929988.125618:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747074176 00000100:00100000:0.0:1788929988.125629:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747074176 00000100:00100000:0.0:1788929988.125710:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 136 00000100:00100000:0.0:1788929988.125721:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:11293:x1875828747074176:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788929988.125744:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929988.125766:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d232 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210395 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.125838:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d239 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.125853:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d239 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.125866:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d239 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.125881:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d240 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.125901:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d240 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.125998:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d240 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126334:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d247 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126345:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d247 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126353:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d247 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929988.126365:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788929988.126586:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d239 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126595:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d239 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126603:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d239 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126610:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929988.126615:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d239 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126624:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d239 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126637:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2e83038e00) 00010000:00010000:0.0:1788929988.126640:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929988.126652:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d239 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126660:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d239 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126674:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d240 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126680:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d240 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126686:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d240 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126691:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929988.126695:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d240 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126701:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d240 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126708:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d2e83038a00) 00010000:00010000:0.0:1788929988.126711:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929988.126713:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d240 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.126720:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d240 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788929988.127567:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788929988.129550:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d232 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210395 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.129593:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d247 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210395 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929988.129602:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:0.0:1788929988.129605:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929988.129608:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8600, rc 0) 00000100:00100000:0.0:1788929988.129687:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:11293:x1875828747074176:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 3968us (4226us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788929988.129696:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 136 00000100:00100000:3.0:1788929988.136880:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929988.137407:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747074304 00000100:00100000:2.0:1788929988.137421:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747074304 00000100:00100000:2.0:1788929988.137501:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 137 00000100:00100000:2.0:1788929988.137512:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:11293:x1875828747074304:12345-192.168.204.40@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788929988.137636:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:11293:x1875828747074304:12345-192.168.204.40@tcp:59:lhsmtool_posix.0 Request processed in 125us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929988.137644:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 137 00000100:00100000:3.0:1788929988.137895:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929988.141521:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747074432 00000100:00100000:1.0:1788929988.141548:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747074432 00000100:00100000:1.0:1788929988.141638:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788929988.141648:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e881fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:2359:x1875828747074432:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929988.141665:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929988.141691:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d247 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210395 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929988.141712:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:1.0:1788929988.141718:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929988.141773:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e881fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:2359:x1875828747074432:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 126us (3878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929988.141781:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:0.0:1788929988.576427:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770152960:0@lo:400:kworker.0 00000100:00100000:0.0:1788929988.576513:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929988.576570:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770153472:0@lo:400:kworker.0 00000100:00100000:0.0:1788929988.576595:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929988.576622:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929988.576627:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770153088:0@lo:400:kworker.0 00000100:00100000:0.0:1788929988.576644:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929988.576673:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770152960 00000100:00100000:0.0:1788929988.576681:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770152960 00000100:00100000:0.0:1788929988.576723:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770153088 00000100:00100000:0.0:1788929988.576725:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770153088 00000100:00100000:0.0:1788929988.576751:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788929988.576759:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770152960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929988.576803:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770152960:12345-0@lo:400:kworker.0 Request processed in 45us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929988.576810:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788929988.576840:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788929988.576847:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770153088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929988.576875:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770153088:12345-0@lo:400:kworker.0 Request processed in 30us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929988.576881:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788929988.576899:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770153472 00000100:00100000:0.0:1788929988.576902:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770153472 00000100:00100000:0.0:1788929988.576926:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788929988.576932:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770153472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929988.576962:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770153472:12345-0@lo:400:kworker.0 Request processed in 30us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929988.576968:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788929988.576990:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788929988.576994:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929988.577025:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770153088:0@lo:400:kworker.0 00000100:00100000:0.0:1788929988.577033:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770152960:0@lo:400:kworker.0 00000100:00100000:0.0:1788929988.577040:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770153472:0@lo:400:kworker.0 00000100:00100000:1.0:1788929988.577435:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770153216:0@lo:400:kworker.0 00000100:00100000:1.0:1788929988.577473:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929988.577508:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788929988.577514:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770152832:0@lo:400:kworker.0 00000100:00100000:1.0:1788929988.577545:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929988.577565:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770153344:0@lo:400:kworker.0 00000100:00100000:1.0:1788929988.577582:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929988.577726:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770153216 00000100:00100000:0.0:1788929988.577731:0:12006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770153216 00000100:00100000:0.0:1788929988.577772:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788929988.577778:0:12006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770153216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929988.577817:0:12006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770153216:12345-0@lo:400:kworker.0 Request processed in 39us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929988.577823:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788929988.577867:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770153216:0@lo:400:kworker.0 00000100:00100000:0.0:1788929988.577905:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770153344 00000100:00100000:0.0:1788929988.577909:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770153344 00000100:00100000:0.0:1788929988.577933:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788929988.577940:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb536aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770153344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929988.577974:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb536aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770153344:12345-0@lo:400:kworker.0 Request processed in 35us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929988.577980:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788929988.578005:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770153344:0@lo:400:kworker.0 00000100:00100000:3.0:1788929988.578122:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770152832 00000100:00100000:3.0:1788929988.578126:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770152832 00000100:00100000:3.0:1788929988.578159:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788929988.578165:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770152832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929988.578201:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3308:x1875828770152832:12345-0@lo:400:kworker.0 Request processed in 36us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929988.578207:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788929988.578677:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bddba76f-ee04-4b28-985b-cc9b0811bff7:3308:1875828770152832:0@lo:400:kworker.0 00000100:00080000:1.0:1788929988.578740:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788929988.578745:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788929988.956857:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788929988.956869:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788929988.957370:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788929988.957380:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788929989.020511:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929989.091420:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929989.091443:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770153600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788929989.092547:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929989.092748:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770153600 00000100:00100000:3.0:1788929989.092758:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770153600 00000100:00100000:3.0:1788929989.092822:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788929989.092833:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e890b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770153600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788929989.092872:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929989.092927:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e890b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770153600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929989.092934:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788929989.093267:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770153600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788929989.953763:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929989.959992:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747074560 00000100:00100000:1.0:1788929989.960012:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747074560 00000100:00100000:1.0:1788929989.960111:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 138 00000100:00100000:1.0:1788929989.960139:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:11335:x1875828747074560:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788929989.960163:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929989.960187:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021039c expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.960278:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d25c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.960293:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d25c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.960306:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d25c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.961754:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d263 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.961767:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d263 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.961779:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d263 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962040:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d25c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962049:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d25c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962066:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d25c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962083:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929989.962088:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d25c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962096:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d25c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962108:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038f00) 00010000:00010000:1.0:1788929989.962111:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929989.962116:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d25c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962123:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d25c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962137:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d263 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962143:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d263 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962148:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d263 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962153:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929989.962156:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d263 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962162:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d263 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962180:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d2eb85fd300) 00010000:00010000:1.0:1788929989.962183:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929989.962186:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d263 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962192:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d263 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962254:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d255 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021039c expref: 15 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962265:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038f00) 00010000:00010000:1.0:1788929989.962267:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929989.962270:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021039c expref: 15 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.962279:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152600, rc 0) 00000100:00100000:1.0:1788929989.963300:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:11335:x1875828747074560:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 3159us (9543us total) trans 0 rc 301/301 00000100:00100000:1.0:1788929989.963380:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 138 00000100:00100000:3.0:1788929989.979797:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929989.980347:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747074816 00000100:00100000:1.0:1788929989.980358:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747074816 00000100:00100000:1.0:1788929989.980416:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 139 00000100:00100000:1.0:1788929989.980426:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:11335:x1875828747074816:12345-192.168.204.40@tcp:36:lfs.0 00010000:00010000:1.0:1788929989.980494:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929989.980534:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237cbe1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101dc expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.980564:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038f00) 00010000:00010000:1.0:1788929989.980574:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788929989.980802:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d26a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.980818:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d26a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.980828:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d26a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.980840:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d271 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.980847:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d271 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.980854:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d271 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929989.981720:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788929989.981734:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d26a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.981742:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d26a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.981749:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d26a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.981754:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929989.981764:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d26a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.981771:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d26a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.981782:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2eb85fd300) 00010000:00010000:1.0:1788929989.981785:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929989.981789:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d26a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929989.981795:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d26a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788929989.981812:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000efd25ee5 reply state 000000001214b461 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d271 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929989.981820:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788929989.981917:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:11335:x1875828747074816:12345-192.168.204.40@tcp:36:lfs.0 Request processed in 1489us (2128us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788929989.981924:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 139 00010000:00010000:0.0:1788929989.985944:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d271 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929989.985965:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d271 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929989.985974:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d271 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929989.985979:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929989.985984:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d271 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929989.986010:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d271 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929989.986028:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d2eb85fdf00) 00010000:00010000:0.0:1788929989.986031:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929989.986036:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d271 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929989.986042:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d271 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.044546:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929990.094880:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929990.095068:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747074944 00000100:00100000:0.0:1788929990.095081:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747074944 00000100:00100000:0.0:1788929990.095177:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 140 00000100:00100000:0.0:1788929990.095191:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:11343:x1875828747074944:12345-192.168.204.40@tcp:101:lctl.0 00010000:00010000:0.0:1788929990.095253:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929990.095291:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d278 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.095374:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237d27f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.095387:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237d27f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.095410:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237d27f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929990.095446:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788929990.095464:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929990.095489:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237d27f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.095521:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d278 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103a3 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.095539:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237d27f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103a3 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.095547:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038a00) 00010000:00010000:0.0:1788929990.095550:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788929990.095553:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8200, rc 0) 00000100:00100000:0.0:1788929990.095628:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:11343:x1875828747074944:12345-192.168.204.40@tcp:101:lctl.0 Request processed in 440us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929990.095635:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 140 00000100:00080000:1.0:1788929990.096173:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788929990.163154:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929990.163286:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747075072 00000100:00100000:1.0:1788929990.163298:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747075072 00000100:00100000:1.0:1788929990.163363:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 141 00000100:00100000:1.0:1788929990.163374:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+15:11349:x1875828747075072:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1788929990.163395:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929990.163417:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d286 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103aa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163483:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d28d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163512:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d28d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163525:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d28d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163541:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d294 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163547:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163555:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163658:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d29b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163666:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d29b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163674:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d29b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929990.163702:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788929990.163705:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788929990.163751:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d29b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163765:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d28d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163783:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d28d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163790:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d28d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163796:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929990.163801:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d28d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163809:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d28d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163822:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038a00) 00010000:00010000:1.0:1788929990.163826:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929990.163831:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d28d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163838:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d28d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163855:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163862:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d294 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163868:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d294 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163873:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929990.163883:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d294 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.163890:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d294 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.164107:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d2eb85fd300) 00010000:00010000:1.0:1788929990.164110:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929990.164114:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d294 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.164120:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d294 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.164153:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d286 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103aa expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.164167:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d29b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103aa expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.164174:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:1.0:1788929990.164176:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788929990.164178:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152200, rc 0) 00000100:00100000:1.0:1788929990.164311:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:11349:x1875828747075072:12345-192.168.204.40@tcp:101:bash.0 Request processed in 939us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929990.164319:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 141 00000100:00100000:3.0:1788929990.166841:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929990.167009:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747075328 00000100:00100000:0.0:1788929990.167019:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747075328 00000100:00100000:0.0:1788929990.167087:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 142 00000100:00100000:0.0:1788929990.167099:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+16:11349:x1875828747075328:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:0.0:1788929990.167121:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929990.167142:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d2a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.167303:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d2a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.167329:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.167352:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.167368:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d2b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.167376:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.167382:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788929990.168096:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788929990.168294:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d2b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.168306:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.168316:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.168349:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.168356:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d2a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.168363:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.168369:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929990.168379:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.168388:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d2a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.168400:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:0.0:1788929990.168403:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929990.168408:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d2a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.168414:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d2a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788929990.168428:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000846da328 reply state 00000000b1e7c828 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929990.168437:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788929990.168471:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d2a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b1 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.168484:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d2b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b1 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.168492:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038200) 00010000:00010000:0.0:1788929990.168494:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929990.169082:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8e00, rc 0) 00000100:00100000:3.0:1788929990.169392:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:11349:x1875828747075328:12345-192.168.204.40@tcp:101:bash.0 Request processed in 2291us (2556us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788929990.169402:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 142 00010000:00010000:3.0:1788929990.177423:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.177440:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d2b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.177448:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d2b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.177455:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929990.177460:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d2b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.177467:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d2b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.177486:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2e83038400) 00010000:00010000:3.0:1788929990.177489:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929990.177495:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d2b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929990.178160:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00010000:3.0:1788929990.178327:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d2b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929990.178436:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747075456 00000100:00100000:2.0:1788929990.178445:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747075456 00000100:00100000:2.0:1788929990.178564:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00100000:2.0:1788929990.178575:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2360:x1875828747075456:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:2.0:1788929990.178592:0:6989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929990.178610:0:6989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237d2c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103b8 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788929990.178636:0:6989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788929990.178656:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1788929990.178661:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929990.178671:0:6989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237d2c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b8 expref: 6 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.178710:0:6989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237d2c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b8 expref: 6 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.178723:0:6989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340200, rc 0) 00000100:00100000:2.0:1788929990.178787:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747075456:12345-192.168.204.40@tcp:101:bash.0 Request processed in 214us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929990.178795:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00100000:2.0:1788929990.181443:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00080000:1.0:1788929990.181629:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788929990.181702:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747075584 00000100:00100000:0.0:1788929990.181711:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747075584 00000100:00100000:0.0:1788929990.181798:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 49 00000100:00100000:0.0:1788929990.181808:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:11349:x1875828747075584:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:0.0:1788929990.181837:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929990.181856:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103bf expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.181892:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237d2c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b8 expref: 7 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.181911:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929990.181914:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929990.181920:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.181955:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237d2c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b8 expref: 7 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.181968:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237d2c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b8 expref: 7 pid: 6989 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929990.181982:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1875828770153728:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929990.182082:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244000 going to sleep for 11 seconds 00000100:00100000:3.0:1788929990.184452:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929990.184552:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1875828770153728:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929990.184586:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.184607:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8c00, rc 0) 00000100:00100000:0.0:1788929990.184685:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:11349:x1875828747075584:12345-192.168.204.40@tcp:101:bash.0 Request processed in 2878us (3251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929990.184694:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 49 00000100:00100000:1.0:1788929990.185147:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747075712 00000100:00100000:1.0:1788929990.185155:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747075712 00010000:00010000:1.0:1788929990.185197:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237d2c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b8 expref: 7 pid: 6989 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929990.185257:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 60 00000100:00100000:1.0:1788929990.185266:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747075712:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929990.185281:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929990.185301:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237d2c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b8 expref: 7 pid: 6989 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.185313:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237d2c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b8 expref: 7 pid: 6989 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.185334:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237d2c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b8 expref: 7 pid: 6989 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.185350:0:7629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788929990.185354:0:7629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788929990.185362:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.185371:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.185403:0:7629:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929990.185429:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb536b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7629:1875828770153856:192.168.204.40@tcp:105: 00000100:00100000:1.0:1788929990.185486:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788929990.189101:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb536b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7629:1875828770153856:192.168.204.40@tcp:105: 00010000:00010000:1.0:1788929990.189132:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929990.189193:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2361:x1875828747075712:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 3927us (4749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929990.189205:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 60 00000100:00100000:1.0:1788929990.192633:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929990.192723:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747075968 00000100:00100000:2.0:1788929990.192733:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747075968 00000100:00100000:2.0:1788929990.192801:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 36 00000100:00100000:2.0:1788929990.192812:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb536b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:11349:x1875828747075968:12345-192.168.204.40@tcp:35:bash.0 00000100:00100000:2.0:1788929990.193197:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb536b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:11349:x1875828747075968:12345-192.168.204.40@tcp:35:bash.0 Request processed in 385us (573us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788929990.193206:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 36 00000100:00100000:2.0:1788929990.274764:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929990.274920:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747076224 00000100:00100000:1.0:1788929990.274934:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747076224 00000100:00100000:1.0:1788929990.275006:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 143 00000100:00100000:1.0:1788929990.275017:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:11359:x1875828747076224:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788929990.275044:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929990.275075:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d2d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929990.275163:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788929990.275338:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d2d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103c6 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.275353:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038a00) 00010000:00010000:1.0:1788929990.275356:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788929990.275362:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d2d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103c6 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.275396:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153800, rc 0) 00000100:00100000:1.0:1788929990.275464:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:11359:x1875828747076224:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 449us (710us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1788929990.275472:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 143 00000100:00100000:3.0:1788929990.279317:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929990.279450:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747076480 00000100:00100000:2.0:1788929990.279460:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747076480 00000100:00100000:2.0:1788929990.279527:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 37 00000100:00100000:2.0:1788929990.279537:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:11359:x1875828747076480:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:2.0:1788929990.279805:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:11359:x1875828747076480:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 259us (488us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788929990.279814:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 37 00000100:00100000:2.0:1788929990.347772:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929990.348256:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747076608 00000100:00100000:1.0:1788929990.348268:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747076608 00000100:00100000:1.0:1788929990.348379:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 144 00000100:00100000:1.0:1788929990.348391:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:11365:x1875828747076608:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788929990.348417:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929990.348438:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d2e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103cd expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.348520:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d2e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.348535:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.348547:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929990.348583:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788929990.348586:0:11024:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788929990.348604:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.348630:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d2e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103cd expref: 23 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.348662:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d2e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103cd expref: 22 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.348670:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:1.0:1788929990.348673:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788929990.348677:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152400, rc 0) 00000100:00100000:1.0:1788929990.348776:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:11365:x1875828747076608:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 387us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929990.348782:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 144 00000100:00100000:2.0:1788929990.352791:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929990.353260:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747076864 00000100:00100000:1.0:1788929990.353272:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747076864 00000100:00100000:1.0:1788929990.353372:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 145 00000100:00100000:1.0:1788929990.353385:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:11365:x1875828747076864:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788929990.353407:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929990.353430:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d2ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103d4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.353547:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d2f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.353565:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d2f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.353578:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d2f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929990.353589:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788929990.353738:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d2ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103d4 expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.353757:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d2f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103d4 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.353766:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038200) 00010000:00010000:1.0:1788929990.353769:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788929990.353773:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152e00, rc 0) 00000100:00100000:1.0:1788929990.353959:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:11365:x1875828747076864:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 577us (1177us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788929990.353967:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 145 00000100:00100000:2.0:1788929990.357574:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929990.357658:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929990.357716:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747077248 00000100:00100000:1.0:1788929990.357726:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747077248 00000100:00100000:1.0:1788929990.358010:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:1.0:1788929990.358022:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:2362:x1875828747077248:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929990.358041:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929990.358078:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d2f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103d4 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.358101:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038200) 00010000:00010000:1.0:1788929990.358107:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929990.358164:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:2362:x1875828747077248:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 145us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929990.358172:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:3.0:1788929990.359242:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747077120 00000100:00100000:3.0:1788929990.359254:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747077120 00000100:00100000:3.0:1788929990.359317:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 146 00000100:00100000:3.0:1788929990.359325:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:11365:x1875828747077120:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788929990.359346:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929990.359365:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d304 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.359459:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d30b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.359474:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d30b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.359485:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d30b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929990.359497:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788929990.359633:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d304 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103db expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.359652:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d30b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103db expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.359661:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038200) 00010000:00010000:3.0:1788929990.359664:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788929990.359666:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597400, rc 0) 00000100:00100000:3.0:1788929990.359713:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+25:11365:x1875828747077120:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 387us (2212us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788929990.359719:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 146 00000100:00100000:2.0:1788929990.364706:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929990.364790:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747077376 00000100:00100000:0.0:1788929990.364811:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747077376 00000100:00100000:0.0:1788929990.364875:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 50 00000100:00100000:0.0:1788929990.364887:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2360:x1875828747077376:12345-192.168.204.40@tcp:1:lfs.0 00010000:00010000:0.0:1788929990.364947:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.364968:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.364977:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929990.364983:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929990.364988:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.365029:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.365045:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 6 pid: 6688 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929990.365073:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875828770153984:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929990.365170:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89244000 going to sleep for 11 seconds 00000100:00100000:3.0:1788929990.368302:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929990.368457:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747077504 00000100:00100000:2.0:1788929990.368466:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747077504 00002000:00100000:2.0:1788929990.368531:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d2e862c1f80 x1875828747077504/t0(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:536/0 lens 504/0 e 0 to 0 dl 1788930001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788929990.368543:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2e862c1f80 with x1875828747077504 ext(0->12) 00010000:00010000:2.0:1788929990.368553:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 7 pid: 6688 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.368569:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 7 pid: 6688 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788929990.368577:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d2e862c1f80 00000100:00100000:2.0:1788929990.368612:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:2.0:1788929990.368623:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747077504:12345-192.168.204.40@tcp:4:lfs.0 00000100:00100000:2.0:1788929990.369153:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2361:x1875828747077504:12345-192.168.204.40@tcp:4:lfs.0 Request processed in 530us (860us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788929990.369161:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2 00002000:00100000:2.0:1788929990.369168:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d2e862c1f80 x1875828747077504/t4294967305(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:536/0 lens 504/448 e 0 to 0 dl 1788930001 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788929990.369177:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2e862c1f80 with x1875828747077504 ext(0->12) 00010000:00010000:2.0:1788929990.369183:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 9 pid: 6688 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.369206:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 9 pid: 6688 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788929990.369213:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d2e862c1f80 00000100:00100000:0.0:1788929990.369781:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875828770153984:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929990.369806:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929990.372394:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929990.372715:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747077632 00000100:00100000:2.0:1788929990.372725:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747077632 00010000:00010000:2.0:1788929990.372769:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 9 pid: 6688 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929990.372822:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:2.0:1788929990.372832:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2361:x1875828747077632:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788929990.372847:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788929990.372868:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788929990.372871:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788929989 00002000:00010000:2.0:1788929990.372873:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788929989 00002000:00010000:2.0:1788929990.372875:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788929989 00010000:00010000:2.0:1788929990.372881:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 9 pid: 6688 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.373090:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 9 pid: 6688 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.373118:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f500ad05/0xce4472dd2237d2cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103bf expref: 9 pid: 6688 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.373156:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788929990.373160:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788929990.373165:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.373175:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.373209:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788929990.373316:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.373326:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.373352:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.373360:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.373368:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.373375:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788929990.373379:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.373387:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.373411:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.373418:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f77cf08/0xce4472dd2237d319 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929990.373501:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2360:x1875828747077376:12345-192.168.204.40@tcp:1:lfs.0 Request processed in 8608us (8797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929990.373510:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 50 00000100:00100000:2.0:1788929990.374195:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747077632:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 1359us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929990.374205:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:3.0:1788929990.376694:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929990.376848:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747077888 00000100:00100000:2.0:1788929990.376858:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747077888 00000100:00100000:2.0:1788929990.376918:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 38 00000100:00100000:2.0:1788929990.376927:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90957050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+25:11365:x1875828747077888:12345-192.168.204.40@tcp:35:lfs.0 00000004:00010000:2.0:1788929990.376996:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d30b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103db expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788929990.377307:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788929990.377352:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788929990.377863:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788929990.377919:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.377936:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d2b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b1 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.377953:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.377987:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d2b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b1 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.378002:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d2b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b1 expref: 29 pid: 5841 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929990.378017:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1875828770154112:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788929990.378114:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2ebc28dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788929990.380300:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1875828770154112:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929990.380330:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929990.382272:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929990.382400:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747078016 00000100:00100000:0.0:1788929990.382410:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747078016 00010000:00010000:0.0:1788929990.382452:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d2b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b1 expref: 30 pid: 5841 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929990.382495:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:0.0:1788929990.382511:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+30:2362:x1875828747078016:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929990.382526:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929990.382532:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d2b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b1 expref: 30 pid: 5841 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.382545:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d2b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b1 expref: 30 pid: 5841 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.382565:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d2b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103b1 expref: 30 pid: 5841 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.382596:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038200) 00010000:00010000:0.0:1788929990.382602:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.382612:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.382619:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.382655:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929990.382713:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:2362:x1875828747078016:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 204us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929990.382720:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 62 00010000:00010000:2.0:1788929990.383340:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.383350:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788929990.383472:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788929990.383690:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788929990.383860:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875828770154240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788929990.383980:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929990.384076:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9aebdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788929990.387116:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770154240 00000100:00100000:1.0:1788929990.387134:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770154240 00000100:00100000:1.0:1788929990.387236:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788929990.387249:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875828770154240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788929990.387476:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875828770154240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 228us (3494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929990.387487:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788929990.387501:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788929990.387574:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875828770154240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788929990.388656:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788929990.388749:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85551500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875828770154368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788929990.388817:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929990.388982:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2ebc28d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788929990.389295:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770154368 00000100:00100000:1.0:1788929990.389303:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770154368 00000100:00100000:1.0:1788929990.389338:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788929990.389347:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875828770154368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788929990.389527:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875828770154368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 180us (709us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788929990.389534:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788929990.389624:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85551500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875828770154368:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788929990.389681:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788929990.389762:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.389840:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.389850:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.389856:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929990.389861:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.389870:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.389886:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038200) 00010000:00010000:3.0:1788929990.389889:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788929990.389894:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929990.389911:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d320 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788929990.390418:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788929990.390561:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788929990.390574:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375546349454ns, next at 376546346392ns, rc = 0 00000001:00080000:3.0:1788929990.390581:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788929990.390620:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038200) 00010000:00010000:3.0:1788929990.390623:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788929990.390631:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d30b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103db expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929990.390739:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90957050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:11365:x1875828747077888:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 13812us (14055us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788929990.390748:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 38 00000020:00080000:3.0:1788929990.390753:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788929990.392865:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929990.392998:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747078144 00000100:00100000:0.0:1788929990.393008:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747078144 00000100:00100000:0.0:1788929990.393081:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 147 00000100:00100000:0.0:1788929990.393093:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:11365:x1875828747078144:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929990.393119:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929990.393144:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d327 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103e2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.393208:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d327 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103e2 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.393255:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d327 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103e2 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.393289:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:0.0:1788929990.393292:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788929990.393295:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9c00, rc 0) 00000100:00100000:0.0:1788929990.393343:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+33:11365:x1875828747078144:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 251us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929990.393350:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 147 00000100:00100000:0.0:1788929990.397450:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929990.397542:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747078400 00000100:00100000:1.0:1788929990.397553:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747078400 00000100:00100000:1.0:1788929990.397615:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:1.0:1788929990.397626:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+33:11365:x1875828747078400:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:1.0:1788929990.397897:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:11365:x1875828747078400:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 272us (459us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788929990.397906:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:0.0:1788929990.517734:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929990.517993:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747078656 00000100:00100000:3.0:1788929990.518003:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747078656 00000100:00100000:3.0:1788929990.518079:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 148 00000100:00100000:3.0:1788929990.518089:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:11375:x1875828747078656:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788929990.518115:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929990.518385:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d32e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929990.525425:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788929990.525568:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d32e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103e9 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.525587:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038a00) 00010000:00010000:2.0:1788929990.525606:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788929990.525612:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d32e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103e9 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.525632:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597400, rc 0) 00000100:00100000:2.0:1788929990.525717:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:11375:x1875828747078656:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 7628us (7993us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788929990.525726:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 148 00000100:00100000:2.0:1788929990.534557:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929990.534674:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747078784 00000100:00100000:0.0:1788929990.534684:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747078784 00000100:00100000:0.0:1788929990.534740:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 149 00000100:00100000:0.0:1788929990.534748:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:11375:x1875828747078784:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:0.0:1788929990.534821:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d33c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.534838:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d33c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.534850:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d33c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.534866:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d343 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.534873:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.534880:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.534983:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d34a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.534992:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d34a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.534999:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d34a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788929990.535042:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d34a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535065:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d33c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535072:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d33c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535079:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d33c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535086:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929990.535090:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d33c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535099:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d33c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535110:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:0.0:1788929990.535113:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929990.535117:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d33c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535130:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d33c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535143:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535150:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d343 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535156:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535160:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929990.535163:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535169:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d343 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535175:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2e83038800) 00010000:00010000:0.0:1788929990.535177:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929990.535180:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d343 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535185:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d343 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535198:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d34a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535203:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d34a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535213:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d34a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535218:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929990.535254:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d34a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535261:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d34a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535269:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:0.0:1788929990.535271:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929990.535274:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d34a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.535280:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d34a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929990.535346:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:11375:x1875828747078784:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 598us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929990.535353:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 149 00000100:00100000:0.0:1788929990.545875:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929990.546057:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747079040 00000100:00100000:1.0:1788929990.546068:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747079040 00000100:00100000:1.0:1788929990.546613:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:1.0:1788929990.546627:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:11375:x1875828747079040:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:1.0:1788929990.546916:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:11375:x1875828747079040:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 291us (1052us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788929990.546925:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:3.0:1788929990.580624:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929990.580765:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747079296 00000100:00100000:1.0:1788929990.580774:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747079296 00000100:00100000:1.0:1788929990.580840:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 150 00000100:00100000:1.0:1788929990.580850:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:11378:x1875828747079296:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788929990.580875:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929990.580907:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d351 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103f0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.580983:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d358 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.580996:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581008:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581022:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d35f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581029:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d35f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581036:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d35f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581161:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581184:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581192:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929990.581203:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788929990.581336:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581344:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d358 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581352:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d358 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581358:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929990.581362:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d358 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581368:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d358 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581380:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:1.0:1788929990.581383:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929990.581388:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d358 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581394:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d358 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581408:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d35f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581420:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d35f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581426:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d35f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581432:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929990.581435:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d35f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581440:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d35f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581447:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2eb85fd300) 00010000:00010000:1.0:1788929990.581449:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929990.581452:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d35f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581458:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d35f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581520:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d351 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103f0 expref: 39 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581534:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103f0 expref: 38 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.581541:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:1.0:1788929990.581544:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788929990.581552:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152c00, rc 0) 00000100:00100000:1.0:1788929990.581616:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:11378:x1875828747079296:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 768us (1002us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788929990.581623:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 150 00000100:00100000:2.0:1788929990.584151:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929990.584341:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747079424 00000100:00100000:0.0:1788929990.584352:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747079424 00000100:00100000:0.0:1788929990.584450:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 151 00000100:00100000:0.0:1788929990.584461:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:11378:x1875828747079424:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:0.0:1788929990.584529:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d374 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.584568:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.584580:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.584604:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.584610:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d374 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.584616:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.584622:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929990.584625:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.584631:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d374 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.584641:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:0.0:1788929990.584644:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788929990.584648:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d374 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929990.584653:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d374 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929990.584726:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:11378:x1875828747079424:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 267us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929990.584740:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 151 00000100:00100000:0.0:1788929990.591924:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929990.592014:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747079680 00000100:00100000:3.0:1788929990.592061:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747079680 00000100:00100000:3.0:1788929990.592124:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 41 00000100:00100000:3.0:1788929990.592143:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:11378:x1875828747079680:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:3.0:1788929990.592430:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+39:11378:x1875828747079680:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 296us (517us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788929990.592438:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 41 00000100:00100000:1.0:1788929990.621151:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788929990.621176:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770154496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788929990.621267:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929990.621326:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770154496 00000100:00100000:1.0:1788929990.621333:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770154496 00000100:00100000:1.0:1788929990.621387:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788929990.621396:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770154496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788929990.621432:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929990.621479:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770154496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929990.621487:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788929990.621539:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770154496:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788929990.624120:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788929990.685292:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000001:00080000:2.0:1788929990.685314:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000001:00080000:2.0:1788929990.685345:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000004:00080000:2.0:1788929990.685352:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788929990.685370:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2e983d5600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788929990.685375:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2eb59cc800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2e983d5e40 00000020:00080000:2.0:1788929990.685379:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2eb59cca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2eb53fd000 00000020:00080000:2.0:1788929990.685520:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788929990.685705:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788929990.685716:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788929990.685736:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770154624:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788929990.685807:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929990.685871:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770154624 00000100:00100000:2.0:1788929990.685879:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770154624 00000100:00100000:2.0:1788929990.685923:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788929990.685933:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875828770154624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788929990.685957:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1788929990.686004:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa0e7c5, atime: 0x6aa0e7c5, ctime: 0x6aa0e7c5, blocks: 0xb 00010000:00010000:2.0:1788929990.686012:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237d37b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.686029:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1788929990.686033:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929990.686039:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237d37b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.686065:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237d37b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.686075:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237d37b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.686082:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237d37b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.686098:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788929990.686576:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1875828770154624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 644us (768us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788929990.686585:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1788929990.686612:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788929990.686618:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237d37b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.686627:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788929990.686638:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237d37b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.686648:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237d37b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.686667:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237d37b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.686675:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237d37b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929990.686695:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929990.686697:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929990.686698:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788929990.686731:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2d86d8ed80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788929990.686737:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770154624:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1788929990.722337:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1788929990.722459:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1788929990.889610:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929990.889768:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747079936 00000100:00100000:1.0:1788929990.889780:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747079936 00000100:00100000:1.0:1788929990.889868:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 152 00000100:00100000:1.0:1788929990.889879:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+17:11409:x1875828747079936:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:1.0:1788929990.889913:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929990.889935:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d382 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103f7 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.890049:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d389 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.890080:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.890095:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929990.890109:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788929990.890413:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d382 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103f7 expref: 20 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.890432:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103f7 expref: 19 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.890441:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:1.0:1788929990.890444:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788929990.890448:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153800, rc 0) 00000100:00100000:1.0:1788929990.890784:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:11409:x1875828747079936:12345-192.168.204.40@tcp:101:cat.0 Request processed in 905us (1184us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788929990.890792:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 152 00000100:00100000:2.0:1788929990.900155:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929990.900397:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929990.900746:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747080320 00000100:00100000:3.0:1788929990.900758:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747080320 00000100:00100000:3.0:1788929990.900819:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 42 00000100:00100000:3.0:1788929990.900829:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:11409:x1875828747080320:12345-192.168.204.40@tcp:35:cat.0 00000100:00100000:3.0:1788929990.901108:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:11409:x1875828747080320:12345-192.168.204.40@tcp:35:cat.0 Request processed in 279us (710us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788929990.901116:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 42 00000100:00100000:1.0:1788929990.902235:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747080064 00000100:00100000:1.0:1788929990.902245:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747080064 00000100:00100000:1.0:1788929990.902333:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:1.0:1788929990.902341:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:2361:x1875828747080064:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929990.902354:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929990.902376:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d389 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103f7 expref: 20 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.902410:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:1.0:1788929990.902415:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929990.902464:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:2361:x1875828747080064:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 123us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929990.902471:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:2.0:1788929990.988895:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929990.989032:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747080576 00000100:00100000:1.0:1788929990.989053:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747080576 00000100:00100000:1.0:1788929990.989116:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 153 00000100:00100000:1.0:1788929990.989126:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:11415:x1875828747080576:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:1.0:1788929990.989152:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929990.989156:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788929990.989185:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d2e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103cd expref: 19 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.989205:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:1.0:1788929990.989210:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788929990.989275:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d397 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402103fe expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.989399:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.989415:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d366 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103f0 expref: 19 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.989423:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.989467:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103f0 expref: 19 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929990.989492:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103f0 expref: 19 pid: 11024 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929990.989507:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5368a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770154752:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929990.989607:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e180 going to sleep for 11 seconds 00000040:00080000:2.0:1788929991.003510:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788929991.003534:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788929991.004175:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788929991.004184:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788929991.009787:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929991.009965:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5368a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770154752:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929991.009997:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929991.010179:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747080704 00000100:00100000:2.0:1788929991.010186:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747080704 00010000:00010000:2.0:1788929991.010249:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103f0 expref: 20 pid: 11024 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929991.010302:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:2.0:1788929991.010311:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:2361:x1875828747080704:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788929991.010327:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929991.010333:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103f0 expref: 20 pid: 11024 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.010345:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103f0 expref: 20 pid: 11024 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.010367:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d366 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103f0 expref: 20 pid: 11024 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.010382:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:2.0:1788929991.010387:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.010396:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.010404:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.010429:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929991.010477:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:2361:x1875828747080704:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 166us (700us total) trans 0 rc 0/0 00010000:00010000:0.0:1788929991.010697:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.010705:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929991.010722:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788929991.010874:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d397 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103fe expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.010901:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103fe expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.010907:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:0.0:1788929991.010910:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788929991.010913:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152e00, rc 0) 00000100:00100000:0.0:1788929991.010941:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:11415:x1875828747080576:12345-192.168.204.40@tcp:101:dd.0 Request processed in 21816us (22068us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788929991.010949:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 153 00000100:00100000:2.0:1788929991.011142:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:3.0:1788929991.014369:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929991.014465:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747080960 00000100:00100000:1.0:1788929991.014476:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747080960 00000100:00100000:1.0:1788929991.014555:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 154 00000100:00100000:1.0:1788929991.014566:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:11415:x1875828747080960:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:1.0:1788929991.014869:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d3ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929991.014899:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d3ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929991.014912:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d3ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788929991.014971:0:11024:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1788929991.014995:0:11024:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b820192e reply state 000000006019d253 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d3ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929991.015012:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788929991.015122:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:11415:x1875828747080960:12345-192.168.204.40@tcp:36:dd.0 Request processed in 557us (763us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788929991.015130:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 154 00000020:00080000:1.0:1788929991.015135:0:11024:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788929991.020280:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d3ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.020302:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d3ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.020332:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d3ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.020338:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929991.020344:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d3ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.020352:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d3ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.020370:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:0.0:1788929991.020373:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929991.020378:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d3ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.020385:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d3ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.072570:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929991.128724:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929991.128780:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929991.128824:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929991.129267:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747081344 00000100:00100000:2.0:1788929991.129278:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747081344 00000100:00100000:2.0:1788929991.129341:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 155 00000100:00100000:2.0:1788929991.129352:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747081344:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929991.129436:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747081344:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 85us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929991.129444:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 155 00000100:00100000:0.0:1788929991.129534:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747081216 00000100:00100000:0.0:1788929991.129539:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747081216 00000100:00100000:0.0:1788929991.129582:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 91 00000100:00100000:0.0:1788929991.129590:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747081216:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788929991.129620:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747081216:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 32us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929991.129626:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 91 00000100:00100000:1.0:1788929991.129791:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747081088 00000100:00100000:1.0:1788929991.129796:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747081088 00000100:00100000:1.0:1788929991.129836:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 294 00000100:00100000:1.0:1788929991.129844:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747081088:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929991.129889:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747081088:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 35us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929991.129896:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 294 00000100:00080000:3.0:1788929991.130458:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788929991.130463:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788929991.338740:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929991.339064:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747081472 00000100:00100000:2.0:1788929991.339079:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747081472 00000100:00100000:2.0:1788929991.339159:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 155 00000100:00100000:2.0:1788929991.339171:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:11429:x1875828747081472:12345-192.168.204.40@tcp:101:stat.0 00010000:00010000:2.0:1788929991.339203:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929991.339257:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d3b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210405 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.339341:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d3ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.339358:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d3ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.339372:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d3ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.339390:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d3c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.339396:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.339422:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.345188:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.345240:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103fe expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.345250:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3c8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.345311:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103fe expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.345329:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103fe expref: 22 pid: 5839 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929991.345346:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875828770154880:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788929991.345551:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9aebd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788929991.353499:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929991.355012:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747081728 00000100:00100000:3.0:1788929991.355028:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747081728 00000100:00100000:3.0:1788929991.355117:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00100000:3.0:1788929991.355128:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:5598:x1875828747081728:12345-192.168.204.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788929991.355540:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:5598:x1875828747081728:12345-192.168.204.40@tcp:35:ldlm_bl.0 Request processed in 413us (2052us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788929991.355550:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00100000:2.0:1788929991.356995:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875828770154880:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788929991.357024:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929991.358440:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929991.358728:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747081856 00000100:00100000:2.0:1788929991.358739:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747081856 00010000:00010000:2.0:1788929991.358789:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103fe expref: 24 pid: 5839 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929991.358863:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:2.0:1788929991.358874:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e881fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:2361:x1875828747081856:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788929991.358901:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929991.358909:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103fe expref: 24 pid: 5839 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.358920:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103fe expref: 24 pid: 5839 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.358944:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d39e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402103fe expref: 24 pid: 5839 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.358961:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:2.0:1788929991.358967:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.358977:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.358984:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3c8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.359017:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929991.359088:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e881fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:2361:x1875828747081856:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 216us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929991.359096:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 64 00010000:00010000:0.0:1788929991.359621:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359643:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929991.359692:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788929991.359697:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929991.359721:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359735:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359744:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d3ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359749:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d3ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359757:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d3ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359763:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929991.359768:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d3ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359775:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d3ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359786:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:0.0:1788929991.359789:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929991.359792:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d3ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359809:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d3ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359824:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359830:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d3c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359836:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359841:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929991.359844:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359851:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d3c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359858:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2e98756c00) 00010000:00010000:0.0:1788929991.359860:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929991.359863:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d3c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359869:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d3c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359917:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d3b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210405 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359931:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210405 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.359945:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:0.0:1788929991.359948:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929991.359951:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340a00, rc 0) 00000100:00100000:0.0:1788929991.360001:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:11429:x1875828747081472:12345-192.168.204.40@tcp:101:stat.0 Request processed in 20832us (21275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929991.360008:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 155 00000100:00100000:0.0:1788929991.432011:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929991.432161:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747082112 00000100:00100000:2.0:1788929991.432184:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747082112 00000100:00100000:2.0:1788929991.432279:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 156 00000100:00100000:2.0:1788929991.432291:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:11435:x1875828747082112:12345-192.168.204.40@tcp:36:truncate.0 00010000:00010000:2.0:1788929991.432349:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929991.432374:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210405 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.432393:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:2.0:1788929991.432397:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788929991.432624:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d3cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.432638:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d3cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.432648:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d3cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788929991.432727:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788929991.432752:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c459be8 reply state 00000000b3d62c45 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d3cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929991.432760:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788929991.432852:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:11435:x1875828747082112:12345-192.168.204.40@tcp:36:truncate.0 Request processed in 563us (854us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788929991.432859:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 156 00000020:00080000:2.0:1788929991.432864:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788929991.443630:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d3cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.443649:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d3cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.443657:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d3cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.443664:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929991.443669:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d3cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.443677:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d3cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.443695:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:0.0:1788929991.443699:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929991.443704:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d3cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.443711:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d3cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929991.641078:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929991.641153:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747082240 00000100:00100000:3.0:1788929991.641166:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747082240 00000100:00100000:3.0:1788929991.641255:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 157 00000100:00100000:3.0:1788929991.641266:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:11449:x1875828747082240:12345-192.168.204.40@tcp:101:stat.0 00010000:00010000:3.0:1788929991.641290:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929991.641311:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237d3d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021040c expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.641376:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d3dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.641390:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d3dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.641402:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d3dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.641417:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d3e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.641424:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.641431:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.642269:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d3eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.642291:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d3eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.642301:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d3eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929991.642343:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788929991.642349:0:11024:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788929991.642376:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d3eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.642388:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d3eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.642396:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d3dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.642403:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d3dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.642410:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d3dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.642416:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929991.642421:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d3dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.642429:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d3dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.642441:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:3.0:1788929991.643970:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929991.643980:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d3dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.643989:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d3dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.644013:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.644020:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d3e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.644039:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d3e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.644045:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929991.644049:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d3e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.644055:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d3e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.644069:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2e907e4900) 00010000:00010000:3.0:1788929991.644072:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929991.644075:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d3e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.644081:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d3e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.644133:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237d3d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021040c expref: 25 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.644167:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d3eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021040c expref: 24 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.644174:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:3.0:1788929991.644177:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788929991.644179:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597400, rc 0) 00000100:00100000:3.0:1788929991.644353:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:11449:x1875828747082240:12345-192.168.204.40@tcp:101:stat.0 Request processed in 3085us (3281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929991.644362:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 157 00000100:00100000:3.0:1788929991.787220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929991.792096:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747082496 00000100:00100000:2.0:1788929991.792114:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747082496 00000100:00100000:2.0:1788929991.792191:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 158 00000100:00100000:2.0:1788929991.792214:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:11459:x1875828747082496:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788929991.792735:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929991.792763:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210413 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929991.793411:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788929991.793720:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210413 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.793737:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038a00) 00010000:00010000:2.0:1788929991.793740:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788929991.793745:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d3f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210413 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.793764:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340a00, rc 0) 00000100:00100000:2.0:1788929991.795591:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+25:11459:x1875828747082496:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 3366us (8371us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788929991.795603:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 158 00000100:00100000:1.0:1788929991.804616:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929991.804706:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747082752 00000100:00100000:3.0:1788929991.804717:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747082752 00000100:00100000:3.0:1788929991.804784:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 44 00000100:00100000:3.0:1788929991.804795:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90956050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+25:11459:x1875828747082752:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:3.0:1788929991.805743:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90956050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:11459:x1875828747082752:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 942us (1133us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788929991.805752:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 44 00000100:00100000:1.0:1788929991.872771:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929991.872949:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747083008 00000100:00100000:0.0:1788929991.872962:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747083008 00000100:00100000:0.0:1788929991.873045:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 159 00000100:00100000:0.0:1788929991.873055:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb536a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:11465:x1875828747083008:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:0.0:1788929991.873082:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929991.873104:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d400 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021041a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.873212:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.873414:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d3eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021040c expref: 27 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.873425:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.873573:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d3eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021040c expref: 27 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.873587:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d3eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021040c expref: 27 pid: 11024 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929991.873601:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875828770155008:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929991.873724:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788929991.878401:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929991.878582:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747083136 00000100:00100000:3.0:1788929991.878591:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747083136 00010000:00010000:3.0:1788929991.878633:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d3eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021040c expref: 28 pid: 11024 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929991.878678:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:3.0:1788929991.878689:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+28:2361:x1875828747083136:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929991.878705:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929991.878726:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d3eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021040c expref: 28 pid: 11024 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.878739:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d3eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021040c expref: 28 pid: 11024 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.878765:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:3.0:1788929991.878770:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.878779:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.878788:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.878817:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929991.878884:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+28:2361:x1875828747083136:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 196us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929991.878891:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 65 00010000:00010000:0.0:1788929991.880160:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d3eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021040c expref: 27 pid: 11024 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929991.880204:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875828770155008:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929991.880272:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.880284:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.880291:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929991.880311:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788929991.880713:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d400 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021041a expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.880730:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021041a expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.880738:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:0.0:1788929991.880741:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788929991.880743:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9e00, rc 0) 00000100:00100000:0.0:1788929991.880849:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb536a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:11465:x1875828747083008:12345-192.168.204.40@tcp:101:bash.0 Request processed in 7738us (8032us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788929991.880857:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 159 00000100:00100000:1.0:1788929991.884580:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929991.884664:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747083392 00000100:00100000:0.0:1788929991.884674:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747083392 00000100:00100000:0.0:1788929991.884757:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 160 00000100:00100000:0.0:1788929991.884767:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb536bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:11465:x1875828747083392:12345-192.168.204.40@tcp:36:bash.0 00010000:00010000:0.0:1788929991.885179:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d415 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.885196:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929991.885208:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788929991.885295:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788929991.885321:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f45bc321 reply state 00000000a93d8c2a transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929991.885330:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788929991.885429:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb536bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+30:11465:x1875828747083392:12345-192.168.204.40@tcp:36:bash.0 Request processed in 661us (856us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788929991.885446:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 160 00000020:00080000:0.0:1788929991.885451:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788929991.891547:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.891566:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d415 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.891574:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d415 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.891580:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929991.891585:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d415 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.891610:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d415 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.891627:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:3.0:1788929991.891630:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929991.891635:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d415 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.891641:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d415 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929991.891965:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929991.892339:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747083520 00000100:00100000:3.0:1788929991.892349:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747083520 00000100:00100000:3.0:1788929991.892405:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 161 00000100:00100000:3.0:1788929991.892414:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb536b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:11465:x1875828747083520:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1788929991.892679:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929991.892700:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237d41c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210421 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.892779:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.892795:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021041a expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.892815:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d423 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.892850:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021041a expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929991.892942:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021041a expref: 30 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929991.892955:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebefdfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770155136:192.168.204.40@tcp:104: 00000100:00100000:3.0:1788929991.893091:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90277240 going to sleep for 11 seconds 00000100:00100000:1.0:1788929991.898103:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929991.898371:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747083648 00000100:00100000:2.0:1788929991.898382:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747083648 00010000:00010000:2.0:1788929991.898430:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021041a expref: 31 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929991.898623:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 66 00000100:00100000:2.0:1788929991.898634:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:2362:x1875828747083648:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788929991.898651:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929991.898658:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021041a expref: 31 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.898688:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021041a expref: 31 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.898711:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:2.0:1788929991.898717:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.898727:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.898735:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d423 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.898756:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929991.899121:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5369f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:2362:x1875828747083648:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 487us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929991.899129:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 66 00010000:00010000:3.0:1788929991.899310:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d407 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021041a expref: 30 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929991.899333:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebefdfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770155136:192.168.204.40@tcp:104: 00010000:00010000:3.0:1788929991.899357:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.899631:0:11024:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.899640:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929991.899687:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788929991.899692:0:11024:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788929991.899713:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.899746:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237d41c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210421 expref: 30 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.899773:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210421 expref: 29 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929991.899780:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:2.0:1788929991.899783:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788929991.899785:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596400, rc 0) 00000100:00100000:2.0:1788929991.899832:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb536b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:11465:x1875828747083520:12345-192.168.204.40@tcp:101:bash.0 Request processed in 7418us (7871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929991.899839:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 161 00000100:00100000:1.0:1788929991.906628:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929991.906709:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747083904 00000100:00100000:0.0:1788929991.906719:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747083904 00000100:00100000:0.0:1788929991.906773:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 45 00000100:00100000:0.0:1788929991.906784:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:11465:x1875828747083904:12345-192.168.204.40@tcp:35:bash.0 00000100:00100000:0.0:1788929991.907148:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+30:11465:x1875828747083904:12345-192.168.204.40@tcp:35:bash.0 Request processed in 366us (529us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788929991.907157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 45 00000100:00100000:1.0:1788929992.003975:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929992.004095:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747084160 00000100:00100000:2.0:1788929992.004106:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747084160 00000100:00100000:2.0:1788929992.004190:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 162 00000100:00100000:2.0:1788929992.004201:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb536b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+30:11475:x1875828747084160:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788929992.004269:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929992.004292:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d42a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210428 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929992.004398:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788929992.004541:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d42a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210428 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.004557:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038a00) 00010000:00010000:2.0:1788929992.004560:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788929992.004565:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d42a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210428 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.004924:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340a00, rc 0) 00000100:00100000:2.0:1788929992.004994:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb536b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:11475:x1875828747084160:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 795us (1030us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788929992.005001:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 162 00000100:00080000:3.0:1788929992.005592:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929992.011134:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929992.015136:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747084288 00000100:00100000:0.0:1788929992.015152:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747084288 00000100:00100000:0.0:1788929992.015244:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 163 00000100:00100000:0.0:1788929992.015256:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:11475:x1875828747084288:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:0.0:1788929992.015431:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d438 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.015461:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d438 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.015587:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d438 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.015605:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d43f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.015613:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d43f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.015619:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d43f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.015925:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d446 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.015935:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.015943:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788929992.016416:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.016438:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d438 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.016457:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d438 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017087:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d438 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017097:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929992.017102:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d438 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017110:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d438 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017124:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:0.0:1788929992.017127:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929992.017131:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d438 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017138:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d438 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017154:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d43f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017160:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d43f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017166:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d43f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017171:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929992.017181:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d43f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017188:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d43f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017196:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2e83038800) 00010000:00010000:0.0:1788929992.017198:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929992.017201:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d43f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017207:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d43f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017268:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017275:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d446 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017281:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017286:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929992.017289:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017296:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d446 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017305:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:0.0:1788929992.017307:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929992.017317:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d446 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.017323:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d446 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929992.017416:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:11475:x1875828747084288:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 2158us (6286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929992.017427:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 163 00000100:00100000:1.0:1788929992.031911:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929992.031999:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747084544 00000100:00100000:3.0:1788929992.032010:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747084544 00000100:00100000:3.0:1788929992.032084:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 46 00000100:00100000:3.0:1788929992.032095:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:11475:x1875828747084544:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:3.0:1788929992.032365:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:11475:x1875828747084544:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 271us (464us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788929992.032372:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 46 00010000:00010000:0.0:1788929992.092760:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929992.100804:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929992.101280:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747084800 00000100:00100000:0.0:1788929992.101298:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747084800 00000100:00100000:0.0:1788929992.101443:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 164 00000100:00100000:0.0:1788929992.101454:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:11478:x1875828747084800:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929992.101479:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929992.101503:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d44d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021042f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.101583:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d454 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.101599:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d454 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.101612:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d454 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.101627:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d45b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.101634:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d45b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.101657:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d45b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.102822:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.102905:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.102918:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929992.102929:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788929992.103031:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d454 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103039:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d454 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103046:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d454 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103052:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929992.103056:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d454 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103064:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d454 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103075:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:0.0:1788929992.103078:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929992.103091:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d454 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103098:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d454 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103112:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d45b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103118:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d45b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103124:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d45b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103129:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929992.103133:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d45b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103139:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d45b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103146:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2e83038800) 00010000:00010000:0.0:1788929992.103149:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929992.103152:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d45b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103157:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d45b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103205:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d44d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021042f expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103413:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021042f expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.103422:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:0.0:1788929992.103424:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929992.103427:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8c00, rc 0) 00000100:00100000:0.0:1788929992.103512:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:11478:x1875828747084800:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 2058us (2717us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788929992.103520:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 164 00000100:00100000:1.0:1788929992.111607:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929992.111914:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929992.112131:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747085056 00000100:00100000:3.0:1788929992.112143:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747085056 00000100:00100000:3.0:1788929992.112219:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:3.0:1788929992.112251:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:2361:x1875828747085056:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929992.112269:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929992.112306:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021042f expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929992.112328:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:3.0:1788929992.112334:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929992.112402:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+33:2361:x1875828747085056:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 153us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929992.112410:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:2.0:1788929992.113044:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747084928 00000100:00100000:2.0:1788929992.113051:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747084928 00000100:00100000:2.0:1788929992.113315:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 165 00000100:00100000:2.0:1788929992.113329:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+33:11478:x1875828747084928:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:2.0:1788929992.113397:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d470 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.113414:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.113427:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.113608:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.113617:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d470 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.113624:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.113631:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929992.113636:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.113658:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d470 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.113671:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:2.0:1788929992.113674:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788929992.113678:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d470 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.113685:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d470 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929992.113792:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+33:11478:x1875828747084928:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 465us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929992.113800:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 165 00000100:00100000:1.0:1788929992.126404:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929992.126609:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747085312 00000100:00100000:3.0:1788929992.126620:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747085312 00000100:00100000:3.0:1788929992.126746:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 47 00000100:00100000:3.0:1788929992.126757:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+33:11478:x1875828747085312:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:3.0:1788929992.127042:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:11478:x1875828747085312:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 285us (647us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788929992.127050:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 47 00000100:00100000:1.0:1788929992.325212:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929992.325371:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747085568 00000100:00100000:2.0:1788929992.325382:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747085568 00000100:00100000:2.0:1788929992.325450:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 166 00000100:00100000:2.0:1788929992.325462:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:11497:x1875828747085568:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:2.0:1788929992.325499:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929992.325522:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d477 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210436 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.325623:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d47e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.325639:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d47e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.325651:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d47e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929992.325682:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788929992.325828:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d477 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210436 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.325849:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d47e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210436 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.325871:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:2.0:1788929992.325874:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788929992.325878:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341e00, rc 0) 00000100:00100000:2.0:1788929992.325944:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:11497:x1875828747085568:12345-192.168.204.40@tcp:101:cat.0 Request processed in 484us (742us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788929992.325958:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 166 00000100:00100000:1.0:1788929992.356730:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929992.356840:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747085696 00000100:00100000:0.0:1788929992.356851:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747085696 00000100:00100000:0.0:1788929992.356922:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 167 00000100:00100000:0.0:1788929992.356932:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:11498:x1875828747085696:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929992.356957:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929992.356980:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d48c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021043d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.357063:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.357078:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.357090:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929992.357122:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788929992.357138:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929992.357158:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.357182:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d48c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021043d expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.357199:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021043d expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929992.357208:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:0.0:1788929992.357210:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788929992.357214:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8000, rc 0) 00000100:00100000:0.0:1788929992.357323:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:11498:x1875828747085696:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 392us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929992.357329:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 167 00000100:00100000:1.0:1788929992.365139:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929992.365273:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747086080 00000100:00100000:0.0:1788929992.365284:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747086080 00000100:00100000:0.0:1788929992.365347:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00100000:0.0:1788929992.365357:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:11498:x1875828747086080:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:0.0:1788929992.366060:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:11498:x1875828747086080:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 701us (930us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788929992.366070:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00100000:1.0:1788929992.372649:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929992.372741:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747086208 00000100:00100000:3.0:1788929992.372753:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747086208 00000100:00100000:3.0:1788929992.372824:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:3.0:1788929992.372835:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88163480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:11498:x1875828747086208:12345-192.168.204.40@tcp:103:lfs.0 00010000:00010000:3.0:1788929992.372853:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788929992.372887:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210421 expref: 38 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929992.372910:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d47e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210436 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929992.372924:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d327 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103e2 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929992.372949:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e83038700) 00010000:00010000:3.0:1788929992.372960:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929992.373029:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88163480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:11498:x1875828747086208:12345-192.168.204.40@tcp:103:lfs.0 Request processed in 196us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929992.373037:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:1.0:1788929992.377042:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929992.377139:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747086336 00000100:00100000:2.0:1788929992.377149:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747086336 00000100:00100000:2.0:1788929992.377208:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 168 00000100:00100000:2.0:1788929992.377218:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:11498:x1875828747086336:12345-192.168.204.40@tcp:58:lfs.0 00010000:00010000:2.0:1788929992.377398:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d49a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.377418:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d49a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.377432:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d49a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788929992.377789:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788929992.378039:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:11498:x1875828747086336:12345-192.168.204.40@tcp:58:lfs.0 Request processed in 749us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929992.378050:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 168 00000100:00100000:1.0:1788929992.416359:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929992.416483:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747086464 00000100:00100000:2.0:1788929992.416495:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747086464 00000100:00100000:2.0:1788929992.416567:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 169 00000100:00100000:2.0:1788929992.416578:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:11500:x1875828747086464:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788929992.416600:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929992.416623:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d4a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210444 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.416694:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.416709:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.416722:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.416738:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.416746:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.416753:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417403:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d4b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417428:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417437:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929992.417491:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788929992.417496:0:11024:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788929992.417516:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417529:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417538:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417546:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417553:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417559:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929992.417564:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417571:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417583:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:2.0:1788929992.417592:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929992.417598:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417604:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417632:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417639:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417645:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417651:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929992.417655:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417660:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417668:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2e98756000) 00010000:00010000:2.0:1788929992.417670:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929992.417673:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417679:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417716:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237d4a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210444 expref: 37 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417742:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210444 expref: 36 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929992.417749:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e98756400) 00010000:00010000:2.0:1788929992.417752:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788929992.417754:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340400, rc 0) 00000100:00100000:2.0:1788929992.417835:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:11500:x1875828747086464:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1258us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929992.417844:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 169 00000040:00080000:2.0:1788929993.059347:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788929993.059358:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788929993.059395:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788929993.059402:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788929993.061369:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875828770155264:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788929993.061673:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e22c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788929993.075645:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875828770155264:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788929993.078376:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929993.078634:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747086592 00000100:00100000:2.0:1788929993.078644:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747086592 00000100:00100000:2.0:1788929993.078710:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 170 00000100:00100000:2.0:1788929993.078721:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:11511:x1875828747086592:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788929993.078754:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788929993.078860:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:11511:x1875828747086592:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 139us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929993.078868:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 170 00000100:00100000:1.0:1788929993.096749:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929993.096839:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747086720 00000100:00100000:0.0:1788929993.096850:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747086720 00000100:00100000:0.0:1788929993.096910:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 171 00000100:00100000:0.0:1788929993.096920:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:11511:x1875828747086720:12345-192.168.204.40@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788929993.097020:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d4bd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097037:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d4bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097051:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d4bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097067:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d4c4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097074:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097080:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097108:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d4cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097117:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d4cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097124:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d4cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929993.097165:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788929993.097169:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929993.097181:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d4cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097193:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d4bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097207:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d4bd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097214:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d4bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097219:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929993.097260:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d4bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097269:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d4bd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097284:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:0.0:1788929993.097287:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929993.097292:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d4bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097298:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d4bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097313:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097320:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d4c4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097326:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097331:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929993.097340:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097347:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097356:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8d2e83038200) 00010000:00010000:0.0:1788929993.097358:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929993.097361:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d4c4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097367:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d4c4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097381:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d4cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097387:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d4cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097393:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d4cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097398:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929993.097401:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d4cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097407:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d4cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097425:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e98756400) 00010000:00010000:0.0:1788929993.097427:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929993.097437:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d4cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.097588:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d4cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929993.097667:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:11511:x1875828747086720:12345-192.168.204.40@tcp:34:lhsmtool_posix.0 Request processed in 747us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929993.097676:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 171 00000100:00100000:0.0:1788929993.103722:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929993.103803:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747086976 00000100:00100000:2.0:1788929993.103815:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747086976 00000100:00100000:2.0:1788929993.103880:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 172 00000100:00100000:2.0:1788929993.103890:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:11511:x1875828747086976:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788929993.103914:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929993.103934:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021044b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.104047:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.104062:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.104074:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929993.104088:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788929993.104182:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.104190:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.104197:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.104203:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929993.104208:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.104215:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.104273:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e98756400) 00010000:00010000:2.0:1788929993.104277:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788929993.104282:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.104289:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.104329:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4d2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021044b expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.104339:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:2.0:1788929993.104342:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788929993.104345:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021044b expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.104353:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341400, rc 0) 00000100:00100000:2.0:1788929993.104404:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:11511:x1875828747086976:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 516us (693us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788929993.104535:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 172 00000100:00100000:1.0:1788929993.111116:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929993.111261:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747087104 00000100:00100000:0.0:1788929993.111273:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747087104 00000100:00100000:0.0:1788929993.111631:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 173 00000100:00100000:0.0:1788929993.111642:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:11511:x1875828747087104:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788929993.111679:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788929993.111788:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:11511:x1875828747087104:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 147us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929993.111796:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 173 00010000:00010000:2.0:1788929993.115640:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929993.129776:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929993.129895:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747087360 00000100:00100000:2.0:1788929993.129907:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747087360 00000100:00100000:2.0:1788929993.129970:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 174 00000100:00100000:2.0:1788929993.129982:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:11511:x1875828747087360:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788929993.130014:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929993.130017:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788929993.130061:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021043d expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.130081:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:2.0:1788929993.130086:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788929993.130102:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210452 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788929993.130857:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788929993.131135:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.131151:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.131163:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.131219:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d4e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210452 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.131259:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210452 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.131266:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788929993.131269:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788929993.131272:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341e00, rc 0) 00000100:00100000:2.0:1788929993.131340:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:11511:x1875828747087360:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 1360us (1574us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788929993.131360:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 174 00000100:00100000:0.0:1788929993.140347:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929993.140485:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747087616 00000100:00100000:3.0:1788929993.140496:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747087616 00000100:00100000:3.0:1788929993.140563:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 175 00000100:00100000:3.0:1788929993.140575:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:11511:x1875828747087616:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788929993.140640:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929993.140670:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d4ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210452 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.140688:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788929993.140701:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788929993.140724:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d4fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.140738:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d4fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.140748:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d4fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.140821:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d503 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xaabaa2bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.140854:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaabaa2bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141433:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaabaa2bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141679:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d4fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141687:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d4fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141694:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d4fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141700:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929993.141704:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d4fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141712:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d4fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141723:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:3.0:1788929993.141726:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929993.141730:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d4fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141737:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237d4fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141747:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaabaa2bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141760:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d503 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaabaa2bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141765:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d503 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaabaa2bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141769:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929993.141773:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d503 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaabaa2bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141779:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d503 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaabaa2bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.141786:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xaabaa2bc (ffff8d2e907e4900) 00010000:00010000:3.0:1788929993.141789:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929993.141791:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d503 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xaabaa2bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.142027:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596400/0xce4472dd2237d503 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xaabaa2bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929993.142136:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:11511:x1875828747087616:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 1561us (1798us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788929993.142145:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 175 00000100:00100000:1.0:1788929993.147269:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929993.153429:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747087744 00000100:00100000:3.0:1788929993.153442:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747087744 00000100:00100000:3.0:1788929993.153649:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 176 00000100:00100000:3.0:1788929993.153660:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:11511:x1875828747087744:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788929993.153690:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929993.153728:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237d50a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210459 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.153765:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d511 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.153778:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.153790:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.153907:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237d50a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210459 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.153923:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210459 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.153931:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:3.0:1788929993.153935:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788929993.153939:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597400, rc 0) 00000100:00100000:3.0:1788929993.154024:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:11511:x1875828747087744:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 366us (6764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929993.154032:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 176 00000100:00100000:3.0:1788929993.159498:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929993.159671:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747088000 00000100:00100000:1.0:1788929993.159680:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747088000 00000100:00100000:1.0:1788929993.159740:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 177 00000100:00100000:1.0:1788929993.159749:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:11511:x1875828747088000:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788929993.159829:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d518 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.160041:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d518 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.160057:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d518 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788929993.160423:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788929993.160433:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378316209112ns, next at 379316206923ns, rc = 0 00000004:00010000:1.0:1788929993.162025:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fd6f2f9 reply state 000000008efe8f3c transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d518 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929993.162065:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788929993.162281:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+40:11511:x1875828747088000:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 2528us (2790us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788929993.162291:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 177 00010000:00010000:1.0:1788929993.166726:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d518 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.166745:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d518 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.166754:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d518 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.166762:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929993.166767:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d518 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.166775:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d518 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.166797:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:1.0:1788929993.166800:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788929993.166805:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d518 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.166812:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d518 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929993.174012:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929993.174191:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747088128 00000100:00100000:1.0:1788929993.174204:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747088128 00000100:00100000:1.0:1788929993.174334:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 178 00000100:00100000:1.0:1788929993.174346:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+39:11511:x1875828747088128:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788929993.174373:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929993.174395:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d51f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210460 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.174475:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d51f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210460 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.174491:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d51f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210460 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.174513:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:1.0:1788929993.174516:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788929993.174521:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152c00, rc 0) 00000100:00100000:1.0:1788929993.174841:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+40:11511:x1875828747088128:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 496us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929993.174850:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 178 00000100:00100000:3.0:1788929993.178246:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929993.178284:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747088256 00000100:00100000:0.0:1788929993.178294:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747088256 00000100:00080000:3.0:1788929993.178433:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788929993.178892:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 52 00000100:00100000:0.0:1788929993.178905:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747088256:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788929993.179312:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2362:x1875828747088256:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 Request processed in 410us (1093us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788929993.179321:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 52 00000100:00100000:2.0:1788929993.183171:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929993.183211:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747088512 00000100:00100000:2.0:1788929993.183220:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747088512 00000100:00100000:2.0:1788929993.190886:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 49 00000100:00100000:2.0:1788929993.190912:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+40:11511:x1875828747088512:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788929993.191190:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+41:11511:x1875828747088512:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 290us (8029us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788929993.191199:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 49 00000100:00100000:3.0:1788929993.199305:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929993.199382:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747088768 00000100:00100000:2.0:1788929993.199394:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747088768 00000100:00100000:2.0:1788929993.199480:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 179 00000100:00100000:2.0:1788929993.199492:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+41:11511:x1875828747088768:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788929993.199607:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+41:11511:x1875828747088768:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 117us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929993.199617:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 179 00000100:00100000:0.0:1788929993.213427:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929993.216354:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747088896 00000100:00100000:1.0:1788929993.216369:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747088896 00000100:00100000:0.0:1788929993.220874:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 180 00000100:00100000:0.0:1788929993.220891:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+41:11511:x1875828747088896:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788929993.220914:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929993.220938:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d526 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210467 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.221043:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d52d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.221059:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d52d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.221073:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d52d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929993.221119:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929993.221139:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d52d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.221168:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d526 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210467 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.221185:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d52d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210467 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.221194:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:0.0:1788929993.221197:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788929993.221201:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9600, rc 0) 00000100:00100000:0.0:1788929993.221306:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+42:11511:x1875828747088896:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 420us (7892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929993.221324:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 180 00000100:00100000:2.0:1788929993.227333:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929993.227729:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747089024 00000100:00100000:3.0:1788929993.227752:0:12006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747089024 00000100:00100000:3.0:1788929993.227813:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 53 00000100:00100000:3.0:1788929993.227823:0:12006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747089024:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788929993.227854:0:12006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929993.227876:0:12006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002328cabc/0xce4472dd2237d534 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021046e expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788929993.227907:0:12006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0e7c8, blocks: 0x1 00010000:00010000:3.0:1788929993.227941:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1788929993.227946:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788929993.227955:0:12006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002328cabc/0xce4472dd2237d534 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021046e expref: 8 pid: 12006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.227975:0:12006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002328cabc/0xce4472dd2237d534 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021046e expref: 8 pid: 12006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.227990:0:12006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8677d600, rc 0) 00000100:00100000:3.0:1788929993.228064:0:12006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2361:x1875828747089024:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 242us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929993.228072:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 53 00000100:00100000:0.0:1788929993.237117:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929993.237190:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747089280 00000100:00100000:1.0:1788929993.237200:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747089280 00000100:00100000:1.0:1788929993.237283:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 181 00000100:00100000:1.0:1788929993.237293:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+42:11511:x1875828747089280:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788929993.237402:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+42:11511:x1875828747089280:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 109us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929993.237409:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 181 00000100:00100000:1.0:1788929993.244354:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929993.245050:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747089408 00000100:00100000:2.0:1788929993.245063:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747089408 00000100:00100000:2.0:1788929993.245123:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 54 00000100:00100000:2.0:1788929993.245133:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:11511:x1875828747089408:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788929993.245152:0:6989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929993.245171:0:6989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e97449/0xce4472dd2237d53b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210475 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.245220:0:6989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002328cabc/0xce4472dd2237d534 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021046e expref: 9 pid: 12006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.245248:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929993.245253:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929993.245259:0:6989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e97449/0xce4472dd2237d53b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210475 expref: 9 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.245295:0:6989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002328cabc/0xce4472dd2237d534 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021046e expref: 9 pid: 12006 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.245308:0:6989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002328cabc/0xce4472dd2237d534 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021046e expref: 9 pid: 12006 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929993.245323:0:6989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6989:1875828770155392:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788929993.245419:0:6989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929993.255813:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929993.255931:0:6989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6989:1875828770155392:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929993.255938:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747089536 00000100:00100000:1.0:1788929993.255947:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747089536 00010000:00010000:2.0:1788929993.255973:0:6989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080e97449/0xce4472dd2237d53b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210475 expref: 10 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.255988:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002328cabc/0xce4472dd2237d534 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021046e expref: 10 pid: 12006 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.256009:0:6989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340600, rc 0) 00000100:00100000:1.0:1788929993.256050:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 67 00000100:00100000:1.0:1788929993.256060:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86aea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:2362:x1875828747089536:12345-192.168.204.40@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788929993.256074:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:11511:x1875828747089408:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 10940us (11728us total) trans 0 rc 0/0 00010000:00010000:1.0:1788929993.256076:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788929993.256086:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 54 00010000:00010000:1.0:1788929993.256106:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002328cabc/0xce4472dd2237d534 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021046e expref: 10 pid: 12006 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.256123:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002328cabc/0xce4472dd2237d534 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021046e expref: 9 pid: 12006 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.256151:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002328cabc/0xce4472dd2237d534 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021046e expref: 9 pid: 12006 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.256165:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788929993.256170:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788929993.256180:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080e97449/0xce4472dd2237d53b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210475 expref: 8 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.256192:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e97449/0xce4472dd2237d53b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210475 expref: 8 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.256262:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000080e97449/0xce4472dd2237d53b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210475 expref: 8 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929993.256278:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1875828770155520:192.168.204.40@tcp:105: 00000100:00100000:1.0:1788929993.256333:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788929993.271285:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929993.271301:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1875828770155520:192.168.204.40@tcp:105: 00010000:00010000:0.0:1788929993.271329:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929993.271375:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747089664 00000100:00100000:2.0:1788929993.271383:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747089664 00000100:00100000:0.0:1788929993.271393:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86aea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2362:x1875828747089536:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 15331us (15597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929993.271405:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 67 00002000:00100000:2.0:1788929993.271436:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d2e86211500 x1875828747089664/t0(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:539/0 lens 504/0 e 0 to 0 dl 1788930004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788929993.271446:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2e86211500 with x1875828747089664 ext(0->8) 00002000:00010000:2.0:1788929993.271451:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2e86211500 00000100:00100000:2.0:1788929993.271496:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:2.0:1788929993.271505:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2361:x1875828747089664:12345-192.168.204.40@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788929993.271985:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:2361:x1875828747089664:12345-192.168.204.40@tcp:4:lhsmtool_posix.0 Request processed in 479us (709us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788929993.271993:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00002000:00100000:2.0:1788929993.272011:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d2e86211500 x1875828747089664/t4294967314(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:539/0 lens 504/448 e 0 to 0 dl 1788930004 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788929993.272019:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2e86211500 with x1875828747089664 ext(0->8) 00002000:00010000:2.0:1788929993.272022:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2e86211500 00000100:00100000:1.0:1788929993.274340:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929993.274924:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747089792 00000100:00100000:2.0:1788929993.274936:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747089792 00000100:00100000:2.0:1788929993.275020:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 182 00000100:00100000:2.0:1788929993.275032:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+42:11511:x1875828747089792:12345-192.168.204.40@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788929993.364397:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+42:11511:x1875828747089792:12345-192.168.204.40@tcp:44:lhsmtool_posix.0 Request processed in 89357us (90055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929993.364411:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 182 00000001:00080000:3.0:1788929993.366532:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:3.0:1788929993.366559:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1788929993.366563:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:3.0:1788929993.366591:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1788929993.366618:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1788929993.366663:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788929993.366674:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788929993.367270:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770155648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788929993.367415:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929993.367535:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770155648 00000100:00100000:1.0:1788929993.367545:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770155648 00000100:00100000:1.0:1788929993.367624:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788929993.367635:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770155648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788929993.367833:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788929993.368119:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788929992 00002000:00010000:1.0:1788929993.368122:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788929993.368125:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788929992 -> 1788929992 00002000:00010000:1.0:1788929993.368128:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788929993.368177:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875828770155648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 543us (762us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788929993.368185:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:0.0:1788929993.368638:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2e86210380/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788929993.368646:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770155648:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1788929993.368739:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788929993.375193:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929993.375348:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747089920 00000100:00100000:3.0:1788929993.375409:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747089920 00000100:00100000:3.0:1788929993.376405:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 56 00000100:00100000:3.0:1788929993.376421:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:2360:x1875828747089920:12345-192.168.204.40@tcp:16:lhsmtool_posix.0 00000040:00080000:2.0:1788929993.428590:0:12450:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788929993.428599:0:12450:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788929993.428661:0:12450:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788929993.428667:0:12450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788929993.472897:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1788929993.472912:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1788929993.472918:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1788929993.473136:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2360:x1875828747089920:12345-192.168.204.40@tcp:16:lhsmtool_posix.0 Request processed in 96714us (97947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929993.473148:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 56 00000100:00100000:1.0:1788929993.483211:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929993.483455:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747090176 00000100:00100000:2.0:1788929993.483467:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747090176 00000100:00100000:2.0:1788929993.483537:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 183 00000100:00100000:2.0:1788929993.483548:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:11511:x1875828747090176:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788929993.483604:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929993.483635:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d52d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210467 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.483656:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:2.0:1788929993.483661:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788929993.483691:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d542 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.483707:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d542 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.483717:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d542 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788929993.484114:0:11024:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ddcfd0d reply state 00000000a1e072d5 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d542 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929993.484125:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788929993.484268:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:11511:x1875828747090176:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 721us (1066us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788929993.484528:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 183 00010000:00010000:3.0:1788929993.514145:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d542 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.514163:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d542 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.514172:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d542 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.514178:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929993.514183:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d542 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.514189:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d542 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.514206:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:3.0:1788929993.514209:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929993.514213:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d542 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.514261:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d542 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929993.521727:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929993.523448:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747090304 00000100:00100000:2.0:1788929993.523464:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747090304 00000100:00100000:2.0:1788929993.523535:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 57 00000100:00100000:2.0:1788929993.523546:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747090304:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788929993.523835:0:6989:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788929993.523853:0:6989:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788929992 -> 1788929990 00002000:00010000:2.0:1788929993.523856:0:6989:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788929989 00002000:00010000:2.0:1788929993.523858:0:6989:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788929992 -> 1788929990 00002000:00010000:2.0:1788929993.523861:0:6989:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788929993.523940:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2361:x1875828747090304:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 Request processed in 394us (2221us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788929993.523947:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 57 00000100:00100000:1.0:1788929993.529601:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929993.529720:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747090560 00000100:00100000:0.0:1788929993.529730:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747090560 00000100:00100000:0.0:1788929993.529792:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 184 00000100:00100000:0.0:1788929993.529803:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:11511:x1875828747090560:12345-192.168.204.40@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788929993.529894:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.529911:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d511 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210459 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.529921:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.529954:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210459 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.529969:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d511 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210459 expref: 18 pid: 5841 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929993.529985:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86ae8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875828770155776:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929993.530083:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aeb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929993.539195:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86ae8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875828770155776:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929993.539261:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929993.541058:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929993.545660:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747090688 00000100:00100000:3.0:1788929993.545676:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747090688 00010000:00010000:3.0:1788929993.545726:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d511 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210459 expref: 19 pid: 5841 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929993.546469:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:3.0:1788929993.546485:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:2361:x1875828747090688:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929993.546504:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929993.546513:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d511 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210459 expref: 19 pid: 5841 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.546528:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210459 expref: 19 pid: 5841 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.546552:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237d511 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210459 expref: 19 pid: 5841 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.546568:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:3.0:1788929993.546574:0:7629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.546584:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.546592:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.546629:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929993.546698:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:2361:x1875828747090688:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 218us (5647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929993.546705:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 68 00010000:00010000:1.0:1788929993.548953:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.548971:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.549016:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.549024:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.549031:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.549038:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929993.549042:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.549050:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.549067:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:1.0:1788929993.549070:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788929993.549075:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.549082:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d549 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929993.549168:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+17:11511:x1875828747090560:12345-192.168.204.40@tcp:55:lhsmtool_posix.0 Request processed in 19362us (19570us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788929993.549190:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 184 00000100:00100000:3.0:1788929993.558785:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929993.558919:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747090816 00000100:00100000:0.0:1788929993.558930:0:12006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747090816 00000100:00100000:0.0:1788929993.559001:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 58 00000100:00100000:0.0:1788929993.559013:0:12006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2359:x1875828747090816:12345-192.168.204.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788929993.559062:0:12006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.559091:0:12006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080e97449/0xce4472dd2237d53b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210475 expref: 8 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.559100:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929993.559104:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929993.559108:0:12006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.559144:0:12006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080e97449/0xce4472dd2237d53b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210475 expref: 8 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.559159:0:12006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080e97449/0xce4472dd2237d53b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210475 expref: 8 pid: 6989 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929993.559172:0:12006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86ae8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12006:1875828770155904:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929993.559269:0:12006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aeb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929993.565133:0:12006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86ae8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12006:1875828770155904:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929993.565165:0:12006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929993.565551:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929993.565619:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747090944 00000100:00100000:0.0:1788929993.565626:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747090944 00010000:00010000:0.0:1788929993.565663:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080e97449/0xce4472dd2237d53b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210475 expref: 9 pid: 6989 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929993.565730:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 69 00000100:00100000:0.0:1788929993.565739:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e881ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2359:x1875828747090944:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929993.565756:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929993.565780:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080e97449/0xce4472dd2237d53b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210475 expref: 9 pid: 6989 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.565793:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080e97449/0xce4472dd2237d53b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210475 expref: 9 pid: 6989 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.565818:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e97449/0xce4472dd2237d53b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210475 expref: 9 pid: 6989 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.565837:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929993.565842:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929993.565848:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.565859:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.565888:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929993.565944:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e881ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2359:x1875828747090944:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 205us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929993.565952:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 69 00010000:00010000:0.0:1788929993.566110:0:12006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.566120:0:12006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.566147:0:12006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.566156:0:12006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.566164:0:12006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.566171:0:12006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8e00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788929993.566176:0:12006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.566185:0:12006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.566197:0:12006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.566204:0:12006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e7153f6/0xce4472dd2237d550 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929993.566367:0:12006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2359:x1875828747090816:12345-192.168.204.40@tcp:1:lhsmtool_posix.0 Request processed in 7355us (7594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929993.566376:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 58 00000100:00100000:0.0:1788929993.569635:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929993.569674:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747091200 00000100:00100000:0.0:1788929993.569683:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747091200 00000100:00100000:0.0:1788929993.569735:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 185 00000100:00100000:0.0:1788929993.569744:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+17:11511:x1875828747091200:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788929993.569846:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d557 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.569864:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.569877:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.570117:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.570129:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d51f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210460 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.570139:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.570171:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d51f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210460 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.570200:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d51f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210460 expref: 18 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929993.570215:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86ae8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770156032:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929993.570590:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788929993.575516:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929993.575556:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747091328 00000100:00100000:0.0:1788929993.575565:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747091328 00010000:00010000:0.0:1788929993.575609:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d51f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210460 expref: 19 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929993.575645:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 70 00000100:00100000:0.0:1788929993.575656:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:2362:x1875828747091328:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929993.575673:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929993.575680:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d51f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210460 expref: 19 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.575694:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d51f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210460 expref: 19 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.575715:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:0.0:1788929993.575720:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.575730:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.575750:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.575769:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929993.575834:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:2362:x1875828747091328:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 179us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929993.575841:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 70 00010000:00010000:0.0:1788929993.575949:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d51f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210460 expref: 18 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929993.575965:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86ae8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770156032:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929993.575983:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.576003:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929993.576010:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788929993.576198:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788929993.577515:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788929993.577581:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788929993.577681:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86ae8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875828770156160:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788929993.577752:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929993.577792:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929993.577830:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770156160 00000100:00100000:0.0:1788929993.577844:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770156160 00000100:00100000:0.0:1788929993.577897:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788929993.577907:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1875828770156160:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788929993.578002:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1875828770156160:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929993.578010:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788929993.578048:0:5839:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788929993.578053:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2e86210380, transno 4294967315 00000100:00100000:0.0:1788929993.578066:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86ae8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875828770156160:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788929993.579873:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788929993.579970:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86ae8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875828770156288:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788929993.580031:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929993.580328:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788929993.582623:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770156288 00000100:00100000:1.0:1788929993.582637:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770156288 00000100:00100000:1.0:1788929993.582697:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788929993.582706:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1875828770156288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788929993.583099:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1875828770156288:12345-0@lo:1000:mdt00_000.0 Request processed in 392us (3065us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788929993.583108:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788929993.583975:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86ae8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875828770156288:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788929993.585308:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585323:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585331:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585338:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929993.585343:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585351:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585366:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2e907e4600) 00010000:00010000:1.0:1788929993.585369:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788929993.585373:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585379:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d55e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585421:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d49a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585427:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d49a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585445:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d49a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585451:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929993.585454:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d49a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585459:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d49a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585468:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e98756400) 00010000:00010000:1.0:1788929993.585470:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788929993.585473:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d49a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585479:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d49a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585515:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585531:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d4b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210444 expref: 21 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585539:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585582:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210444 expref: 21 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.585598:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d4b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210444 expref: 21 pid: 11024 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929993.585613:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e86210380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770156416:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929993.585699:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788929993.600203:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929993.600472:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e86210380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770156416:192.168.204.40@tcp:104: 00010000:00010000:3.0:1788929993.600501:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929993.601946:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747091456 00000100:00100000:1.0:1788929993.601961:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747091456 00010000:00010000:1.0:1788929993.602029:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d4b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210444 expref: 22 pid: 11024 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929993.602927:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 71 00000100:00100000:1.0:1788929993.602943:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:2361:x1875828747091456:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929993.602963:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929993.602972:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d4b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210444 expref: 22 pid: 11024 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.602999:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210444 expref: 22 pid: 11024 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.603023:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d4b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210444 expref: 22 pid: 11024 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.603056:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e98756400) 00010000:00010000:1.0:1788929993.603061:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.603071:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.603079:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.603108:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929993.603171:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:2361:x1875828747091456:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 233us (2978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929993.603178:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 71 00010000:00010000:3.0:1788929993.606675:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.606692:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.606708:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.606715:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.606723:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.606730:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929993.606734:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.606743:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.606763:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e98756400) 00010000:00010000:3.0:1788929993.606767:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929993.606772:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.606796:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d565 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.608553:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.608571:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d557 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.608579:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d557 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.608586:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929993.608591:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d557 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.608599:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d557 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.608615:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e98756400) 00010000:00010000:3.0:1788929993.608618:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788929993.608622:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d557 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929993.608629:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d557 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788929993.616807:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788929993.616819:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788929993.617576:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788929993.617588:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788929993.618491:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:11511:x1875828747091200:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 48736us (48855us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788929993.618507:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 185 00000020:00080000:3.0:1788929993.618525:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788929993.629476:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929993.629918:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747091712 00000100:00100000:1.0:1788929993.629929:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747091712 00000100:00100000:1.0:1788929993.629999:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 50 00000100:00100000:1.0:1788929993.630012:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90951450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:11511:x1875828747091712:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788929993.635270:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788929993.635383:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788929993.635446:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d56c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.635463:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d56c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.635474:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d56c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.635491:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d56c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.635497:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d56c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.635503:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d56c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929993.635527:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788929993.635636:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90951450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:11511:x1875828747091712:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 5623us (6167us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788929993.635646:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 50 00000020:00080000:1.0:1788929993.635651:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788929993.636692:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788929993.636704:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d56c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.636714:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788929993.636719:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d56c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.636727:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d56c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.636741:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2eb85fd300) 00010000:00010000:2.0:1788929993.636744:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788929993.636748:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d56c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.636753:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d56c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929993.636772:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929993.636774:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788929993.636776:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788929993.691550:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770156544:0@lo:400:kworker.0 00000100:00100000:0.0:1788929993.691639:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929993.691770:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770156544 00000100:00100000:1.0:1788929993.691781:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770156544 00000100:00100000:1.0:1788929993.691850:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788929993.691861:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3311:x1875828770156544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788929993.694235:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3311:x1875828770156544:12345-0@lo:400:kworker.0 Request processed in 2346us (2566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929993.694249:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788929993.695099:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770156544:0@lo:400:kworker.0 00000100:00100000:0.0:1788929993.695130:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788929993.695142:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770156928:0@lo:400:kworker.0 00000100:00100000:0.0:1788929993.695197:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929993.698758:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770156672:0@lo:400:kworker.0 00000100:00100000:0.0:1788929993.698865:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929993.698926:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788929993.698934:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770156800:0@lo:400:kworker.0 00000100:00100000:0.0:1788929993.698973:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929993.699024:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770156928 00000100:00100000:0.0:1788929993.699033:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770156928 00000100:00100000:0.0:1788929993.699091:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770156672 00000100:00100000:0.0:1788929993.699094:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770156672 00000100:00100000:0.0:1788929993.699108:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770156800 00000100:00100000:0.0:1788929993.699111:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770156800 00000100:00100000:0.0:1788929993.699128:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788929993.699136:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770156928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929993.699197:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770156928:12345-0@lo:400:kworker.0 Request processed in 61us (3998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929993.699204:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788929993.699244:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788929993.699250:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770156672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929993.699282:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770156672:12345-0@lo:400:kworker.0 Request processed in 32us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929993.699289:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788929993.699301:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788929993.699307:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770156800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929993.699334:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770156800:12345-0@lo:400:kworker.0 Request processed in 28us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929993.699339:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1788929993.699354:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929993.699385:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770156800:0@lo:400:kworker.0 00000100:00100000:0.0:1788929993.699396:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770156672:0@lo:400:kworker.0 00000100:00100000:0.0:1788929993.699429:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770156928:0@lo:400:kworker.0 00000100:00100000:0.0:1788929993.700003:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929993.700015:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770157056:0@lo:400:kworker.0 00000100:00100000:0.0:1788929993.700052:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929993.700132:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770157056 00000100:00100000:3.0:1788929993.700138:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770157056 00000100:00100000:3.0:1788929993.700189:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788929993.700197:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875828770157056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929993.700263:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875828770157056:12345-0@lo:400:kworker.0 Request processed in 67us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929993.700269:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1788929993.700374:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788929993.700394:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788929993.700399:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788929993.700418:0:3310:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d2d86d8ed80 x1875828770154624/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788930006 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929993.700428:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770157056:0@lo:400:kworker.0 00010000:00010000:0.0:1788929994.140814:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929994.204187:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770157184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788929994.204300:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929994.204445:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770157184 00000100:00100000:1.0:1788929994.204455:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770157184 00000100:00100000:1.0:1788929994.204509:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788929994.204518:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875828770157184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788929994.204566:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788929994.204620:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875828770157184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929994.204634:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788929994.204868:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770157184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788929995.168609:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788929995.654204:0:12501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788929995.654213:0:12501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788929995.654285:0:12501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788929995.654293:0:12501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788929995.742455:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb61ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770157312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788929995.742527:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929995.759301:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770157312 00000100:00100000:3.0:1788929995.759319:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770157312 00000100:00100000:3.0:1788929995.759385:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788929995.759396:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875828770157312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788929995.759435:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929995.759804:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875828770157312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (16989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929995.759812:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788929995.759837:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788929995.759895:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb61ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770157312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788929995.859080:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929995.859119:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747091968 00000100:00100000:3.0:1788929995.859130:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747091968 00000100:00100000:3.0:1788929995.859197:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 186 00000100:00100000:3.0:1788929995.859207:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:11529:x1875828747091968:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788929995.859255:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929995.859281:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d573 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021047c expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929995.861209:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c800/0xce4472dd2237d57a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929995.861247:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c800/0xce4472dd2237d57a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929995.861262:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c800/0xce4472dd2237d57a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929995.861275:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788929995.861430:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d573 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021047c expref: 25 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929995.861449:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c800/0xce4472dd2237d57a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021047c expref: 24 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929995.861458:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:3.0:1788929995.861461:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788929995.861465:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8677c800, rc 0) 00000100:00100000:3.0:1788929995.861544:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:11529:x1875828747091968:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 2338us (2471us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788929995.861553:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 186 00000100:00080000:3.0:1788929995.861591:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929995.865972:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929995.866037:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747092096 00000100:00100000:2.0:1788929995.866048:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747092096 00000100:00100000:2.0:1788929995.866107:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 187 00000100:00100000:2.0:1788929995.866128:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:11529:x1875828747092096:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:2.0:1788929995.866203:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d588 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866252:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d588 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866266:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d588 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866283:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d58f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866291:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d58f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866298:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d58f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866660:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d596 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866670:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866679:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788929995.866733:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866748:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d588 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866755:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d588 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866764:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d588 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866770:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929995.866776:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d588 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866785:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d588 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866798:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:2.0:1788929995.866801:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929995.866807:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d588 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866813:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d588 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866826:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d58f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866832:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d58f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866845:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d58f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866851:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929995.866855:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d58f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866861:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d58f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866869:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2e98756c00) 00010000:00010000:2.0:1788929995.866871:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929995.866874:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d58f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866880:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d58f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866895:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866902:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d596 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866908:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866913:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929995.866916:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866931:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d596 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866941:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788929995.866944:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929995.866958:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d596 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.866963:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d596 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929995.869020:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:11529:x1875828747092096:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 2890us (3043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929995.869036:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 187 00000001:00080000:3.0:1788929995.877668:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:0.0:1788929995.939799:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929995.945888:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747092352 00000100:00100000:1.0:1788929995.945907:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747092352 00000100:00100000:1.0:1788929995.945995:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 188 00000100:00100000:1.0:1788929995.946007:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:11532:x1875828747092352:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788929995.946031:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929995.946053:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d59d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210483 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946141:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d5a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946160:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d5a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946175:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d5a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946192:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946200:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946207:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946594:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d5b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946604:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946613:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929995.946623:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788929995.946729:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d5a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946738:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d5a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946746:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d5a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946753:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929995.946758:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d5a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946767:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d5a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946781:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:1.0:1788929995.946784:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929995.946791:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d5a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946809:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d5a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946824:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946831:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946837:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946842:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929995.946846:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946852:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946860:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2eb85fd200) 00010000:00010000:1.0:1788929995.946863:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929995.946866:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946873:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946915:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d59d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210483 expref: 27 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946955:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210483 expref: 26 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929995.946964:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:1.0:1788929995.946967:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788929995.946969:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152c00, rc 0) 00000100:00100000:1.0:1788929995.947052:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:11532:x1875828747092352:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1047us (7263us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788929995.947060:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 188 00000100:00100000:3.0:1788929995.954323:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929995.954482:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747092480 00000100:00100000:2.0:1788929995.954493:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747092480 00000100:00100000:2.0:1788929995.954560:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 189 00000100:00100000:2.0:1788929995.954573:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:11532:x1875828747092480:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:2.0:1788929995.954646:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d5c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.954664:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.954677:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.954709:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.954737:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.954744:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.954750:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929995.954756:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.954765:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d5c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.954779:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:2.0:1788929995.954782:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788929995.954788:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d5c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929995.954794:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d5c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929995.954863:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:11532:x1875828747092480:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 293us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929995.954871:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 189 00000100:00100000:2.0:1788929995.958259:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929995.958357:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747092736 00000100:00100000:0.0:1788929995.958367:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747092736 00000100:00100000:0.0:1788929995.958421:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 51 00000100:00100000:0.0:1788929995.958434:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:11532:x1875828747092736:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:0.0:1788929995.958706:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:11532:x1875828747092736:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 273us (495us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788929995.958714:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 51 00000100:00100000:0.0:1788929996.028482:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929996.028646:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747092992 00000100:00100000:1.0:1788929996.028658:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747092992 00000100:00100000:1.0:1788929996.028721:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 190 00000100:00100000:1.0:1788929996.028731:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:11057:x1875828747092992:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1788929996.028757:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929996.028780:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d5c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021048a expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.028885:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.028899:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d5b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210483 expref: 28 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.028907:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.028940:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210483 expref: 28 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.028978:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d5b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210483 expref: 28 pid: 11024 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929996.028993:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770157440:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929996.029093:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788929996.031301:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770157440:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929996.031339:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929996.034461:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929996.034585:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747093120 00000100:00100000:2.0:1788929996.034598:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747093120 00010000:00010000:2.0:1788929996.034644:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d5b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210483 expref: 29 pid: 11024 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929996.034709:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 72 00000100:00100000:2.0:1788929996.034719:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:2362:x1875828747093120:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788929996.034736:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929996.034744:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d5b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210483 expref: 29 pid: 11024 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.034756:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210483 expref: 29 pid: 11024 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.034782:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d5b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210483 expref: 29 pid: 11024 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.034801:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:2.0:1788929996.034806:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.034817:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.034824:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.036650:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929996.036732:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+28:2362:x1875828747093120:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 2008us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929996.036744:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 72 00010000:00010000:1.0:1788929996.042628:0:11024:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.042647:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929996.042672:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788929996.042836:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d5c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021048a expref: 29 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.042861:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021048a expref: 28 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.042870:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:1.0:1788929996.042873:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788929996.042877:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152400, rc 0) 00000100:00100000:1.0:1788929996.042965:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+28:11057:x1875828747092992:12345-192.168.204.40@tcp:101:bash.0 Request processed in 14234us (14494us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788929996.042988:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 190 00000100:00100000:0.0:1788929996.045594:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929996.045755:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747093376 00000100:00100000:2.0:1788929996.045782:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747093376 00000100:00100000:2.0:1788929996.046021:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 191 00000100:00100000:2.0:1788929996.046030:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+28:11057:x1875828747093376:12345-192.168.204.40@tcp:36:bash.0 00010000:00010000:2.0:1788929996.046342:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d5dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.046362:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d5dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.046376:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d5dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788929996.046552:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788929996.046576:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009be64def reply state 00000000945829de transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d5dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929996.046584:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788929996.046699:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788929996.046954:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:11057:x1875828747093376:12345-192.168.204.40@tcp:36:bash.0 Request processed in 767us (1212us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788929996.046963:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 191 00000020:00080000:2.0:1788929996.046968:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788929996.049417:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00010000:1.0:1788929996.049445:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d5dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.049460:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d5dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.049468:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d5dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.049474:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929996.049479:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d5dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.049488:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d5dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.049506:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:1.0:1788929996.049509:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929996.049514:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d5dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.049520:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d5dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929996.050146:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747093504 00000100:00100000:0.0:1788929996.050160:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747093504 00000100:00100000:0.0:1788929996.050267:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 192 00000100:00100000:0.0:1788929996.050296:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:11057:x1875828747093504:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:0.0:1788929996.050325:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929996.050347:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d5e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210491 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.050472:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d5e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210491 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.050488:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d5e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210491 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.050509:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:0.0:1788929996.050512:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788929996.050515:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8400, rc 0) 00000100:00100000:0.0:1788929996.050574:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:11057:x1875828747093504:12345-192.168.204.40@tcp:101:bash.0 Request processed in 281us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929996.050580:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 192 00000100:00100000:0.0:1788929996.060977:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929996.061086:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747093632 00000100:00100000:1.0:1788929996.061095:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747093632 00000100:00100000:1.0:1788929996.061193:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 59 00000100:00100000:1.0:1788929996.061204:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:11057:x1875828747093632:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1788929996.061262:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929996.061303:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237d5ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210498 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788929996.061335:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa0e7c6, atime: 0x6aa0e7c5, ctime: 0x6aa0e7c6, blocks: 0xb 00010000:00010000:1.0:1788929996.061358:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1788929996.061363:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788929996.061371:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237d5ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210498 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.061389:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237d5ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210498 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.061402:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153c00, rc 0) 00000100:00100000:1.0:1788929996.061463:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:11057:x1875828747093632:12345-192.168.204.40@tcp:101:bash.0 Request processed in 262us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929996.061470:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 59 00000100:00080000:3.0:1788929996.061659:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788929996.064054:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929996.066398:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747093760 00000100:00100000:1.0:1788929996.066417:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747093760 00002000:00010000:1.0:1788929996.066468:0:6692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788929996.066473:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2d86d8f100 with x1875828747093760 ext(0->18446744073709551615) 00002000:00010000:1.0:1788929996.066487:0:6692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2d86d8f100. 00000100:00100000:1.0:1788929996.066543:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:1.0:1788929996.066555:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2359:x1875828747093760:12345-192.168.204.40@tcp:10:bash.0 00002000:00010000:1.0:1788929996.066859:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788929996.066864:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788929990 -> 1788929994 00002000:00010000:1.0:1788929996.066867:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788929989 -> 1788929989 00002000:00010000:1.0:1788929996.066885:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788929990 -> 1788929994 00002000:00010000:1.0:1788929996.066887:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788929996.066986:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2359:x1875828747093760:12345-192.168.204.40@tcp:10:bash.0 Request processed in 431us (2938us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788929996.066995:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00002000:00010000:1.0:1788929996.066999:0:6692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788929996.067001:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2d86d8f100 with x1875828747093760 ext(0->18446744073709551615) 00002000:00010000:1.0:1788929996.067006:0:6692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2d86d8f100. 00000100:00100000:2.0:1788929996.173471:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929996.173618:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747093888 00000100:00100000:3.0:1788929996.173639:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747093888 00000100:00100000:3.0:1788929996.173698:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 193 00000100:00100000:3.0:1788929996.173708:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:11546:x1875828747093888:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:3.0:1788929996.173780:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d5f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.173798:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.173810:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.173827:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d5f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.173833:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.173839:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174081:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c000/0xce4472dd2237d5ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174091:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c000/0xce4472dd2237d5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174098:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c000/0xce4472dd2237d5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788929996.174153:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c000/0xce4472dd2237d5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174175:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174182:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d5f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174189:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174195:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929996.174200:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174206:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d5f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174218:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:3.0:1788929996.174255:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929996.174261:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d5f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174267:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d5f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174279:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174286:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d5f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174291:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d5f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174303:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929996.174306:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d5f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174312:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d5f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174322:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2e907e4300) 00010000:00010000:3.0:1788929996.174324:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929996.174327:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d5f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174333:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d5f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174348:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c000/0xce4472dd2237d5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174354:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c000/0xce4472dd2237d5ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174360:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c000/0xce4472dd2237d5ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174365:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677c000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929996.174367:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c000/0xce4472dd2237d5ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174372:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c000/0xce4472dd2237d5ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174454:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:3.0:1788929996.174457:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929996.174460:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c000/0xce4472dd2237d5ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.174466:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c000/0xce4472dd2237d5ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929996.174656:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:11546:x1875828747093888:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 948us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929996.174665:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 193 00010000:00010000:2.0:1788929996.191266:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929996.239367:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929996.239527:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747094144 00000100:00100000:0.0:1788929996.239538:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747094144 00000100:00100000:0.0:1788929996.239605:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 194 00000100:00100000:0.0:1788929996.239615:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+32:11549:x1875828747094144:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929996.239639:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929996.239663:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d606 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021049f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.239739:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d60d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.239769:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d60d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.239793:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d60d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.239811:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d614 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.239818:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.239825:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240106:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d61b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240130:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d61b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240139:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d61b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929996.240149:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788929996.240291:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d60d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240299:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d60d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240306:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d60d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240318:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929996.240323:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d60d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240330:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d60d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240342:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:0.0:1788929996.240345:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929996.240351:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d60d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240357:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d60d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240369:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240375:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d614 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240380:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240398:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929996.240401:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240407:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d614 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240426:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2e83038400) 00010000:00010000:0.0:1788929996.240428:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929996.240432:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d614 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240438:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237d614 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240482:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237d606 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021049f expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240496:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d61b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021049f expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.240503:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:0.0:1788929996.240506:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788929996.240508:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9800, rc 0) 00000100:00100000:0.0:1788929996.240587:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:11549:x1875828747094144:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 973us (1230us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788929996.240595:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 194 00000100:00100000:0.0:1788929996.251743:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929996.251790:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929996.251825:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929996.251892:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747094528 00000100:00100000:1.0:1788929996.251902:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747094528 00000100:00100000:1.0:1788929996.251980:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 159 00000100:00100000:1.0:1788929996.251991:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747094528:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788929996.252067:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747094528:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929996.252075:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 159 00000100:00080000:0.0:1788929996.252136:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788929996.252544:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747094272 00000100:00100000:3.0:1788929996.252550:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747094272 00000100:00100000:3.0:1788929996.252588:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 296 00000100:00100000:3.0:1788929996.252596:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747094272:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788929996.252629:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747094272:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 34us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929996.252635:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 296 00000100:00100000:2.0:1788929996.253001:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747094400 00000100:00100000:2.0:1788929996.253006:0:12006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747094400 00000100:00100000:2.0:1788929996.253052:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 93 00000100:00100000:2.0:1788929996.253060:0:12006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747094400:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788929996.253147:0:12006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747094400:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 87us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929996.253154:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 93 00000100:00080000:0.0:1788929996.253595:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788929996.254579:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929996.254645:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747094656 00000100:00100000:0.0:1788929996.254654:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747094656 00000100:00100000:0.0:1788929996.254695:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 195 00000100:00100000:0.0:1788929996.254716:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:11549:x1875828747094656:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:0.0:1788929996.254793:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.254813:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021048a expref: 34 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.254823:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.254861:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021048a expref: 34 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.254876:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021048a expref: 34 pid: 11024 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929996.254889:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5369180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770157568:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929996.254985:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311900 going to sleep for 11 seconds 00000100:00100000:2.0:1788929996.267835:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929996.269457:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747094912 00000100:00100000:3.0:1788929996.269473:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747094912 00000100:00100000:3.0:1788929996.269544:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 52 00000100:00100000:3.0:1788929996.269555:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:5599:x1875828747094912:12345-192.168.204.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788929996.269910:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:5599:x1875828747094912:12345-192.168.204.40@tcp:35:ldlm_bl.0 Request processed in 356us (2084us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788929996.269918:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 52 00000100:00100000:0.0:1788929996.275207:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5369180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770157568:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929996.275267:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929996.276053:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929996.276139:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747095040 00000100:00100000:3.0:1788929996.276160:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747095040 00010000:00010000:3.0:1788929996.276196:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021048a expref: 36 pid: 11024 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929996.276260:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 73 00000100:00100000:3.0:1788929996.276271:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:2362:x1875828747095040:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929996.276287:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929996.276294:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021048a expref: 36 pid: 11024 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.276308:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021048a expref: 36 pid: 11024 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.276343:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d5ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021048a expref: 36 pid: 11024 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.276363:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:3.0:1788929996.276369:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.276380:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.276575:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.276600:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929996.276662:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:2362:x1875828747095040:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 392us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929996.276680:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 73 00010000:00010000:0.0:1788929996.277127:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.277137:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.277169:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.277184:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.277191:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.277197:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929996.277201:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.277208:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.277218:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:0.0:1788929996.277221:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788929996.277241:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.277247:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d629 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929996.277297:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:11549:x1875828747094656:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 22583us (22724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929996.277306:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 195 00000100:00100000:2.0:1788929996.285854:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929996.285989:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747095296 00000100:00100000:3.0:1788929996.285999:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747095296 00000100:00100000:3.0:1788929996.286062:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 53 00000100:00100000:3.0:1788929996.286072:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+34:11549:x1875828747095296:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:2.0:1788929996.287145:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:11549:x1875828747095296:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 1069us (1296us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788929996.287154:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 53 00000100:00100000:2.0:1788929996.387380:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929996.387496:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747095552 00000100:00100000:1.0:1788929996.387509:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747095552 00000100:00100000:1.0:1788929996.387577:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 196 00000100:00100000:1.0:1788929996.387588:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+35:11560:x1875828747095552:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:1.0:1788929996.387611:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929996.387634:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d630 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402104a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.387706:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d637 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.387721:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d637 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.387748:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d637 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.387767:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d63e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.387774:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d63e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.387791:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d63e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388104:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d645 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388114:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388121:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929996.388132:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788929996.388278:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d637 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388285:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d637 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388292:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d637 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388298:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929996.388309:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d637 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388318:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d637 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388332:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:1.0:1788929996.388334:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929996.388340:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d637 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388346:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d637 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388362:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d63e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388368:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d63e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388373:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d63e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388378:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929996.388382:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d63e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388387:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d63e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388394:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2eb85fd300) 00010000:00010000:1.0:1788929996.388396:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929996.388405:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d63e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388411:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d63e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388457:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d630 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104a6 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388470:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104a6 expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.388477:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:1.0:1788929996.388480:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788929996.388482:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152c00, rc 0) 00000100:00100000:1.0:1788929996.388552:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:11560:x1875828747095552:12345-192.168.204.40@tcp:101:cat.0 Request processed in 965us (1181us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788929996.388560:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 196 00000100:00100000:0.0:1788929996.409840:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929996.410705:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747095808 00000100:00100000:1.0:1788929996.410718:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747095808 00000100:00100000:1.0:1788929996.410784:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 54 00000100:00100000:1.0:1788929996.410795:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:11560:x1875828747095808:12345-192.168.204.40@tcp:35:cat.0 00000100:00100000:1.0:1788929996.411053:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:11560:x1875828747095808:12345-192.168.204.40@tcp:35:cat.0 Request processed in 260us (1223us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788929996.411060:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 54 00000100:00100000:2.0:1788929996.438321:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929996.438419:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747096064 00000100:00100000:1.0:1788929996.438431:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747096064 00000100:00100000:1.0:1788929996.438495:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 197 00000100:00100000:1.0:1788929996.438506:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:11561:x1875828747096064:12345-192.168.204.40@tcp:36:rm.0 00010000:00010000:1.0:1788929996.438582:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788929996.438613:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d645 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104a6 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.438637:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d61b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021049f expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.438651:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237d5e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210491 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.438662:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:1.0:1788929996.438672:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788929996.438693:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d653 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.438707:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d653 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.438716:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d653 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.438730:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d65a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.438737:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d65a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.438743:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d65a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.439203:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d661 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.439214:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d661 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.439221:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d661 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788929996.443057:0:11024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788929996.443078:0:11024:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381598853732ns, next at 382598850114ns, rc = 0 00010000:00010000:1.0:1788929996.443169:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d668 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.443185:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d668 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.443196:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d668 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.443205:0:11024:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d668 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.443212:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d668 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.443219:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d668 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452542:0:11024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788929996.452587:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d661 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452599:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d661 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452623:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d661 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452629:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929996.452634:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d661 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452643:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d661 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452659:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fdf00) 00010000:00010000:0.0:1788929996.452663:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788929996.452668:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d661 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452674:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d661 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452702:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d653 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452708:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d653 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452714:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d653 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452718:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929996.452721:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d653 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452736:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d653 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452744:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:0.0:1788929996.452746:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929996.452750:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d653 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.452755:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d653 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788929996.452765:0:11024:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a706f99 reply state 00000000a090e49d transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d65a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929996.452774:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788929996.452907:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+37:11561:x1875828747096064:12345-192.168.204.40@tcp:36:rm.0 Request processed in 14399us (14593us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788929996.452916:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 197 00010000:00010000:1.0:1788929996.453740:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788929996.453749:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d668 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.453766:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152e00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788929996.453770:0:7628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d668 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.453778:0:7628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d668 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.453812:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2eb85fdf00) 00010000:00010000:1.0:1788929996.453815:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788929996.453818:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d668 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.453825:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d668 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.453845:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929996.453847:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929996.453849:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788929996.456485:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d65a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.456503:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d65a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.456511:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d65a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.456517:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929996.456521:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d65a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.456529:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d65a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.456546:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2eb85fd300) 00010000:00010000:3.0:1788929996.456550:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929996.456555:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d65a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.456561:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d65a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929996.536752:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929996.537115:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747096320 00000100:00100000:1.0:1788929996.537126:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747096320 00000100:00100000:1.0:1788929996.537187:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 198 00000100:00100000:1.0:1788929996.537199:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+36:11567:x1875828747096320:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1788929996.537267:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929996.537287:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d66f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402104ad expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.537415:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d676 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.537449:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.537461:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.537480:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d67d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.537488:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d67d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.537495:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d67d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788929996.538060:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788929996.538215:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.538252:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.538260:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.538294:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.538302:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d676 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.538309:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d676 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.538322:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929996.538326:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d676 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.538334:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d676 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.538348:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:1.0:1788929996.538351:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929996.538355:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d676 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.538362:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d676 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788929996.538377:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6c77c9e reply state 000000008345ed93 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d67d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929996.538385:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788929996.538417:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d66f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ad expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.538431:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ad expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.538438:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:1.0:1788929996.538441:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788929996.538443:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152600, rc 0) 00000100:00100000:1.0:1788929996.538520:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+39:11567:x1875828747096320:12345-192.168.204.40@tcp:101:bash.0 Request processed in 1323us (1779us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788929996.538534:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 198 00000100:00100000:2.0:1788929996.544144:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929996.544258:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747096448 00000100:00100000:3.0:1788929996.544286:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747096448 00000100:00100000:3.0:1788929996.544341:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 60 00000100:00100000:3.0:1788929996.544351:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2362:x1875828747096448:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1788929996.544371:0:6989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929996.544393:0:6989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237d692 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402104b4 expref: -99 pid: 6989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788929996.544423:0:6989:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788929996.544448:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1788929996.544453:0:6989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788929996.544464:0:6989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237d692 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104b4 expref: 6 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.544484:0:6989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237d692 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104b4 expref: 6 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.544498:0:6989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8677c000, rc 0) 00000100:00100000:3.0:1788929996.544565:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747096448:12345-192.168.204.40@tcp:101:bash.0 Request processed in 215us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929996.544572:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 60 00010000:00010000:1.0:1788929996.544832:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d67d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.544842:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d67d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.544849:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d67d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.544856:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929996.544861:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d67d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.544869:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d67d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.544883:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2eb85fdf00) 00010000:00010000:1.0:1788929996.544887:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929996.544892:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d67d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.544898:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d67d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929996.548755:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929996.548854:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747096576 00000100:00100000:0.0:1788929996.548865:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747096576 00000100:00100000:0.0:1788929996.548925:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:0.0:1788929996.548945:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:11567:x1875828747096576:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:0.0:1788929996.548963:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929996.548981:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402104bb expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.549014:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237d692 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104b4 expref: 7 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.549037:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929996.549041:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929996.549046:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.549080:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237d692 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104b4 expref: 7 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.549094:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237d692 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104b4 expref: 7 pid: 6989 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929996.549108:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5368a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875828770157696:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929996.549204:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311600 going to sleep for 11 seconds 00000100:00100000:0.0:1788929996.552855:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5368a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875828770157696:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929996.552901:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.552923:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9e00, rc 0) 00000100:00100000:0.0:1788929996.553016:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:11567:x1875828747096576:12345-192.168.204.40@tcp:101:bash.0 Request processed in 4081us (4271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929996.553025:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:1.0:1788929996.554784:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929996.554872:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747096704 00000100:00100000:2.0:1788929996.554883:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747096704 00010000:00010000:2.0:1788929996.555003:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237d692 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104b4 expref: 7 pid: 6989 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929996.555045:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 74 00000100:00100000:2.0:1788929996.555055:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747096704:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788929996.555071:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929996.555095:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237d692 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104b4 expref: 7 pid: 6989 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.555129:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237d692 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104b4 expref: 7 pid: 6989 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.555156:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237d692 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104b4 expref: 7 pid: 6989 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.555172:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929996.555176:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929996.555183:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.555193:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.555283:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929996.555300:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1875828770157824:192.168.204.40@tcp:105: 00000100:00100000:2.0:1788929996.555404:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e22480 going to sleep for 11 seconds 00000100:00100000:0.0:1788929996.563413:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1875828770157824:192.168.204.40@tcp:105: 00010000:00010000:0.0:1788929996.563445:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929996.563521:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2361:x1875828747096704:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 8466us (8744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929996.563531:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 74 00000100:00100000:3.0:1788929996.564999:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929996.565092:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747096960 00000100:00100000:2.0:1788929996.565101:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747096960 00000100:00100000:2.0:1788929996.565156:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 55 00000100:00100000:2.0:1788929996.565166:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+38:11567:x1875828747096960:12345-192.168.204.40@tcp:35:bash.0 00000100:00100000:2.0:1788929996.565576:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+39:11567:x1875828747096960:12345-192.168.204.40@tcp:35:bash.0 Request processed in 411us (583us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788929996.565595:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 55 00000100:00100000:1.0:1788929996.778736:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929996.778832:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747097088 00000100:00100000:0.0:1788929996.778843:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747097088 00000100:00100000:0.0:1788929996.778903:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 199 00000100:00100000:0.0:1788929996.778914:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+39:11583:x1875828747097088:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929996.778948:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929996.778970:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d6a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402104c2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.779036:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d6a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.779057:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.779070:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929996.779118:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788929996.779122:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929996.779140:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.779165:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d6a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104c2 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.779183:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d6a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104c2 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.779210:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:0.0:1788929996.779212:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788929996.779216:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8c00, rc 0) 00000100:00100000:0.0:1788929996.779323:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+40:11583:x1875828747097088:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 411us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929996.779331:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 199 00000100:00100000:0.0:1788929996.792259:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929996.794276:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747097344 00000100:00100000:1.0:1788929996.794292:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747097344 00000100:00100000:1.0:1788929996.794371:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 200 00000100:00100000:1.0:1788929996.794400:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+40:11583:x1875828747097344:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788929996.794423:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929996.794446:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d6ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402104c9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.794586:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d6b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.794601:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.794615:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929996.794627:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788929996.794768:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d6ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104c9 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.794790:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d6b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104c9 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.794799:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:1.0:1788929996.794801:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788929996.794805:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153800, rc 0) 00000100:00100000:1.0:1788929996.794881:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+42:11583:x1875828747097344:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 484us (2659us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788929996.794890:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 200 00000100:00100000:2.0:1788929996.797845:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929996.797936:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747097600 00000100:00100000:0.0:1788929996.797946:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747097600 00000100:00100000:0.0:1788929996.798006:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 201 00000100:00100000:0.0:1788929996.798016:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+42:11583:x1875828747097600:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929996.798039:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929996.798068:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d6c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402104d0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.798429:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d6ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.798443:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.798455:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929996.798467:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788929996.798601:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d6c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104d0 expref: 45 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.798639:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d6ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104d0 expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.798647:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:0.0:1788929996.798650:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788929996.798654:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9000, rc 0) 00000100:00100000:0.0:1788929996.798717:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+44:11583:x1875828747097600:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 702us (881us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788929996.798724:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 201 00000100:00100000:3.0:1788929996.799661:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929996.799817:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747097728 00000100:00100000:1.0:1788929996.799825:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747097728 00000100:00100000:1.0:1788929996.799886:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:1.0:1788929996.799894:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+44:2361:x1875828747097728:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929996.799910:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929996.801662:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d6b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104c9 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.801694:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:1.0:1788929996.801699:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929996.802474:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+43:2361:x1875828747097728:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 2575us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929996.802485:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:3.0:1788929996.813492:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929996.813788:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747097856 00000100:00100000:0.0:1788929996.813802:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747097856 00000100:00100000:0.0:1788929996.813870:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:0.0:1788929996.813881:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+6:2362:x1875828747097856:12345-192.168.204.40@tcp:1:lfs.0 00010000:00010000:0.0:1788929996.813948:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.813969:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.813978:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929996.813982:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929996.813988:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.814021:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.814059:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 6 pid: 6685 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929996.814075:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5369f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1875828770157952:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929996.814182:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311600 going to sleep for 11 seconds 00000100:00100000:0.0:1788929996.819396:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929996.819505:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5369f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1875828770157952:192.168.204.40@tcp:104: 00010000:00010000:3.0:1788929996.819543:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929996.819714:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747097984 00000100:00100000:2.0:1788929996.819723:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747097984 00002000:00100000:2.0:1788929996.819773:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d2e9ae1ea00 x1875828747097984/t0(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:542/0 lens 504/0 e 0 to 0 dl 1788930007 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788929996.819784:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2e9ae1ea00 with x1875828747097984 ext(0->8) 00010000:00010000:2.0:1788929996.819792:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 7 pid: 6685 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.819807:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 7 pid: 6685 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788929996.819816:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d2e9ae1ea00 00000100:00100000:2.0:1788929996.819845:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:2.0:1788929996.819853:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2362:x1875828747097984:12345-192.168.204.40@tcp:4:lfs.0 00000100:00100000:2.0:1788929996.820608:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2362:x1875828747097984:12345-192.168.204.40@tcp:4:lfs.0 Request processed in 752us (1219us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788929996.820618:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 3 00002000:00100000:2.0:1788929996.820626:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d2e9ae1ea00 x1875828747097984/t4294967308(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:542/0 lens 504/448 e 0 to 0 dl 1788930007 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788929996.820636:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2e9ae1ea00 with x1875828747097984 ext(0->8) 00010000:00010000:2.0:1788929996.820642:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 9 pid: 6685 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.820678:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 9 pid: 6685 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788929996.820687:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d2e9ae1ea00 00000100:00100000:2.0:1788929996.823746:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929996.824274:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747098112 00000100:00100000:0.0:1788929996.824286:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747098112 00010000:00010000:0.0:1788929996.824338:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 9 pid: 6685 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929996.824394:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 75 00000100:00100000:0.0:1788929996.824406:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e881ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2359:x1875828747098112:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929996.824424:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788929996.824447:0:7629:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788929996.824449:0:7629:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788929995 00002000:00010000:0.0:1788929996.824452:0:7629:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788929995 00002000:00010000:0.0:1788929996.824454:0:7629:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788929995 00010000:00010000:0.0:1788929996.824460:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 9 pid: 6685 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.824475:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 9 pid: 6685 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.824522:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dc2e319/0xce4472dd2237d699 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104bb expref: 9 pid: 6685 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.824541:0:7629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929996.824546:0:7629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929996.824552:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.824563:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.824649:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929996.824717:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e881ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2359:x1875828747098112:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 313us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929996.824726:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 75 00010000:00010000:3.0:1788929996.825191:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.825203:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.825262:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.825273:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.825283:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.825291:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8e00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788929996.825295:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.825305:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.825320:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.825344:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e7153f6/0xce4472dd2237d6d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929996.825412:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2362:x1875828747097856:12345-192.168.204.40@tcp:1:lfs.0 Request processed in 11531us (11930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929996.825421:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:3.0:1788929996.828890:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929996.829031:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747098368 00000100:00100000:2.0:1788929996.829041:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747098368 00000100:00100000:2.0:1788929996.829102:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 56 00000100:00100000:2.0:1788929996.829113:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90952850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+43:11583:x1875828747098368:12345-192.168.204.40@tcp:35:lfs.0 00000004:00010000:2.0:1788929996.829182:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d6ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104d0 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788929996.829514:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1788929996.829561:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788929996.829895:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788929996.829968:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.829987:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d684 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ad expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.829997:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.830042:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ad expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.830083:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d684 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ad expref: 47 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929996.830100:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1875828770158080:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788929996.830195:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e22b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788929996.834425:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929996.835145:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747098496 00000100:00100000:0.0:1788929996.835158:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747098496 00000100:00100000:2.0:1788929996.837165:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5843:1875828770158080:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788929996.837198:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.837889:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d684 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ad expref: 48 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929996.837960:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 76 00000100:00100000:0.0:1788929996.837977:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+48:2361:x1875828747098496:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929996.837993:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929996.838002:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d684 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ad expref: 48 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.838103:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ad expref: 48 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.838128:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ad expref: 48 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.838145:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:0.0:1788929996.838151:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.838161:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.838169:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929996.838193:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929996.838275:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+47:2361:x1875828747098496:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 307us (3864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929996.838282:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 76 00010000:00010000:1.0:1788929996.840063:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.840082:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788929996.840246:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788929996.842813:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788929996.843018:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875828770158208:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788929996.843102:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929996.843145:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929996.843181:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770158208 00000100:00100000:0.0:1788929996.843191:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770158208 00000100:00100000:0.0:1788929996.843296:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788929996.843306:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875828770158208:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788929996.843415:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875828770158208:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 110us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929996.843423:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788929996.843578:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788929996.845838:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788929996.845851:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2d86d8ed80, transno 4294967307 00000100:00100000:1.0:1788929996.845867:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875828770158208:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788929996.846477:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788929996.846575:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875828770158336:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788929996.846637:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788929996.846675:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e902779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929996.846689:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770158336 00000100:00100000:0.0:1788929996.846698:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770158336 00000100:00100000:0.0:1788929996.846762:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788929996.846781:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875828770158336:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788929996.847014:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875828770158336:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 242us (375us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788929996.847034:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788929996.847696:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8870f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5843:1875828770158336:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788929996.847760:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788929996.847803:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.847815:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.847824:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.847830:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929996.847835:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.847844:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.847862:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:1.0:1788929996.847866:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788929996.847871:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929996.847877:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341800/0xce4472dd2237d6df lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788929996.848300:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788929996.848546:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788929996.848573:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382004348325ns, next at 383004346392ns, rc = 0 00000001:00080000:1.0:1788929996.848581:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788929996.848618:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2eb85fd900) 00010000:00010000:1.0:1788929996.848622:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788929996.848630:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d6ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104d0 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929996.848865:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90952850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+50:11583:x1875828747098368:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 19752us (19983us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788929996.848874:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 56 00000020:00080000:1.0:1788929996.848880:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788929996.851811:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929996.851898:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747098624 00000100:00100000:2.0:1788929996.851910:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747098624 00000100:00100000:2.0:1788929996.851977:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 202 00000100:00100000:2.0:1788929996.851987:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+50:11583:x1875828747098624:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788929996.852013:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929996.852038:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237d6e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402104d7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.852110:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237d6e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104d7 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.852125:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237d6e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104d7 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929996.852144:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788929996.852148:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788929996.852163:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340000, rc 0) 00000100:00100000:2.0:1788929996.852249:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+51:11583:x1875828747098624:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 236us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929996.852258:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 202 00000100:00100000:0.0:1788929996.855415:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929996.855490:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747098880 00000100:00100000:1.0:1788929996.855500:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747098880 00000100:00100000:1.0:1788929996.855563:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 57 00000100:00100000:1.0:1788929996.855576:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+51:11583:x1875828747098880:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:1.0:1788929996.855854:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:11583:x1875828747098880:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 280us (451us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788929996.855863:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 57 00000100:00100000:0.0:1788929996.996185:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929996.997604:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747099008 00000100:00100000:3.0:1788929996.997618:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747099008 00000100:00100000:3.0:1788929996.997688:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 203 00000100:00100000:3.0:1788929996.997699:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:11593:x1875828747099008:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:3.0:1788929996.997788:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d6ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.997806:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d6ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.997818:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d6ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.997833:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d6f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.997839:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.997846:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.997976:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d6fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.997985:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.997991:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788929996.998035:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998047:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d6ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998054:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d6ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998061:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d6ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998067:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929996.998071:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d6ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998078:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d6ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998089:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:3.0:1788929996.998092:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929996.998109:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d6ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998122:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d6ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998136:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998142:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d6f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998147:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998152:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929996.998155:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998160:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d6f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998167:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2e907e4300) 00010000:00010000:3.0:1788929996.998170:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929996.998173:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d6f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998178:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d6f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998191:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998197:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d6fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998209:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d6fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998214:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929996.998216:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d6fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998273:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d6fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998282:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788929996.998285:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929996.998288:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d6fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929996.998294:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d6fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929996.998670:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:11593:x1875828747099008:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 970us (2494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929996.998679:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 203 00000100:00100000:3.0:1788929997.069737:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.070015:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747099264 00000100:00100000:0.0:1788929997.070025:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747099264 00000100:00100000:0.0:1788929997.070103:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 204 00000100:00100000:0.0:1788929997.070115:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+52:11596:x1875828747099264:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929997.070136:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929997.070157:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d702 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402104de expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070278:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d709 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070293:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d709 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070306:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d709 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070321:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d710 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070333:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070357:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070500:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d717 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070509:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070516:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929997.070527:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788929997.070629:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d709 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070637:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d709 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070645:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d709 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070651:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929997.070656:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d709 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070664:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d709 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070677:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:0.0:1788929997.070681:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929997.070693:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d709 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070700:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d709 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070715:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070722:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d710 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070729:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d710 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070735:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929997.070738:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d710 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070744:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d710 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070752:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2e83038400) 00010000:00010000:0.0:1788929997.070754:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929997.070757:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d710 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070763:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d710 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070827:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d702 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104de expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.070854:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104de expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.071152:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:0.0:1788929997.071155:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929997.071158:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9200, rc 0) 00000100:00100000:0.0:1788929997.071265:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:11596:x1875828747099264:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1151us (1536us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788929997.071274:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 204 00000100:00080000:3.0:1788929997.071345:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788929997.081334:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929997.081475:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747099392 00000100:00100000:3.0:1788929997.081487:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747099392 00000100:00100000:3.0:1788929997.081554:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 205 00000100:00100000:3.0:1788929997.081564:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:11596:x1875828747099392:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:3.0:1788929997.081631:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d725 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.081666:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.081679:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.081708:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.081716:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d725 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.081723:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d725 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.081729:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929997.081734:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d725 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.081741:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d725 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.081752:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788929997.081755:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788929997.081760:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d725 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.081767:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d725 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929997.081844:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:11596:x1875828747099392:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 281us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929997.081857:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 205 00000100:00100000:1.0:1788929997.084793:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.084901:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747099648 00000100:00100000:0.0:1788929997.084912:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747099648 00000100:00100000:0.0:1788929997.084988:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 58 00000100:00100000:0.0:1788929997.084998:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+54:11596:x1875828747099648:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:0.0:1788929997.085295:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:11596:x1875828747099648:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 296us (513us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788929997.085302:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 58 00000100:00100000:1.0:1788929997.164862:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.165481:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747099904 00000100:00100000:2.0:1788929997.165493:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747099904 00000100:00100000:2.0:1788929997.165569:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 206 00000100:00100000:2.0:1788929997.165580:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:11606:x1875828747099904:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:2.0:1788929997.165607:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929997.165610:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788929997.165643:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d6a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104c2 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.165677:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:2.0:1788929997.165683:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788929997.165698:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d72c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402104e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.165806:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.165820:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d717 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104de expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.165829:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.165865:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104de expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.165898:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d717 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104de expref: 55 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929997.165912:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875828770158464:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788929997.166026:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e22b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788929997.169077:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1875828770158464:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788929997.169119:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929997.169992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.170081:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747100032 00000100:00100000:0.0:1788929997.170091:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747100032 00010000:00010000:0.0:1788929997.170143:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d717 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104de expref: 56 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929997.170185:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:0.0:1788929997.170194:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+56:2361:x1875828747100032:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929997.170211:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929997.170262:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d717 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104de expref: 56 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.170275:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104de expref: 56 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.170296:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d717 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104de expref: 56 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.170315:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:0.0:1788929997.170321:0:7629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.170331:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.170338:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.170369:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929997.170439:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:2361:x1875828747100032:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 244us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929997.170446:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 77 00010000:00010000:1.0:1788929997.171062:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.171071:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788929997.171113:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788929997.171325:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340600/0xce4472dd2237d72c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104e5 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.171345:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104e5 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.171353:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:1.0:1788929997.171355:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788929997.171358:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340a00, rc 0) 00000100:00100000:1.0:1788929997.171408:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:11606:x1875828747099904:12345-192.168.204.40@tcp:101:bash.0 Request processed in 5829us (6557us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788929997.171415:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 206 00000100:00100000:1.0:1788929997.176681:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.176783:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747100288 00000100:00100000:0.0:1788929997.176793:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747100288 00000100:00100000:0.0:1788929997.176866:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 207 00000100:00100000:0.0:1788929997.176878:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+55:11606:x1875828747100288:12345-192.168.204.40@tcp:36:bash.0 00010000:00010000:0.0:1788929997.177174:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d741 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.177209:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.177257:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788929997.177318:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788929997.177342:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee3e7ebe reply state 00000000734117b8 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929997.177351:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788929997.178653:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+58:11606:x1875828747100288:12345-192.168.204.40@tcp:36:bash.0 Request processed in 1768us (1972us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788929997.178664:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 207 00000020:00080000:0.0:1788929997.178671:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788929997.185208:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929997.185324:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747100416 00000100:00100000:1.0:1788929997.185336:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747100416 00000100:00100000:1.0:1788929997.185406:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 208 00000100:00100000:1.0:1788929997.185417:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+58:11606:x1875828747100416:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1788929997.185442:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929997.185461:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d748 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402104ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.185543:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.185559:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104e5 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.185585:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d741 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.185591:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.185608:0:5840:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.185634:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104e5 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.185648:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104e5 expref: 59 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929997.185661:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85553100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875828770158592:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929997.185757:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2ebc28d240 going to sleep for 11 seconds 00010000:00010000:3.0:1788929997.187263:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.187278:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d741 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.187286:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d741 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.187292:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929997.187297:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d741 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.187306:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d741 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.187324:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788929997.187327:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929997.187331:0:3295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.187341:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d741 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.187348:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d741 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929997.192157:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85553100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875828770158592:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929997.192191:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929997.194769:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929997.195104:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747100544 00000100:00100000:1.0:1788929997.195114:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747100544 00010000:00010000:1.0:1788929997.195166:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104e5 expref: 59 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929997.195213:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:1.0:1788929997.195269:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+59:2362:x1875828747100544:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788929997.195285:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929997.195293:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104e5 expref: 59 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.195308:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104e5 expref: 59 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.195332:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340a00/0xce4472dd2237d733 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104e5 expref: 59 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.195350:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:1.0:1788929997.195356:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.195366:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.195373:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.195397:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788929997.195459:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+58:2362:x1875828747100544:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 191us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788929997.195467:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 78 00010000:00010000:0.0:1788929997.195528:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.195536:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929997.195580:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788929997.195584:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929997.195603:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.195647:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d748 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ec expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.195673:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ec expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.195680:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:0.0:1788929997.195683:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929997.195686:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152400, rc 0) 00000100:00100000:0.0:1788929997.195713:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+57:11606:x1875828747100416:12345-192.168.204.40@tcp:101:bash.0 Request processed in 10299us (10518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929997.195720:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 208 00010000:00010000:0.0:1788929997.211880:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929997.212817:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.212911:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747100800 00000100:00100000:0.0:1788929997.212933:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747100800 00000100:00100000:0.0:1788929997.212993:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 59 00000100:00100000:0.0:1788929997.213004:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+57:11606:x1875828747100800:12345-192.168.204.40@tcp:35:bash.0 00000100:00100000:0.0:1788929997.213284:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+58:11606:x1875828747100800:12345-192.168.204.40@tcp:35:bash.0 Request processed in 281us (473us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788929997.213292:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 59 00000100:00100000:2.0:1788929997.362885:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929997.363019:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747100928 00000100:00100000:3.0:1788929997.363035:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747100928 00000100:00100000:3.0:1788929997.363114:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 209 00000100:00100000:3.0:1788929997.363125:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+58:11612:x1875828747100928:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788929997.363151:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929997.363176:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402104f3 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.363277:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d75d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.363292:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d75d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.363304:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d75d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929997.363339:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788929997.363343:0:11024:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788929997.363379:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d75d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.363412:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d800/0xce4472dd2237d756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104f3 expref: 60 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.363432:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d75d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104f3 expref: 59 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.363441:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:3.0:1788929997.363443:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788929997.363447:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8677d000, rc 0) 00000100:00100000:3.0:1788929997.363693:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+59:11612:x1875828747100928:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 571us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929997.363708:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 209 00000100:00100000:1.0:1788929997.368372:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929997.368540:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747101056 00000100:00100000:3.0:1788929997.368552:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747101056 00000100:00100000:3.0:1788929997.368622:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 210 00000100:00100000:3.0:1788929997.368633:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+59:11612:x1875828747101056:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788929997.368658:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929997.368684:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d764 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402104fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.368764:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c400/0xce4472dd2237d76b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.368782:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c400/0xce4472dd2237d76b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.368810:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c400/0xce4472dd2237d76b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.368828:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.368835:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.368841:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.368955:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d400/0xce4472dd2237d779 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.368985:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d400/0xce4472dd2237d779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.368993:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d400/0xce4472dd2237d779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788929997.369034:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788929997.369039:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788929997.369061:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d400/0xce4472dd2237d779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369072:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d400/0xce4472dd2237d779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369082:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c400/0xce4472dd2237d76b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369089:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c400/0xce4472dd2237d76b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369096:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c400/0xce4472dd2237d76b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369102:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677c400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929997.369106:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c400/0xce4472dd2237d76b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369114:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c400/0xce4472dd2237d76b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369127:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:3.0:1788929997.369130:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929997.369144:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c400/0xce4472dd2237d76b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369150:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c400/0xce4472dd2237d76b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369163:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369169:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d772 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369176:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369182:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677dc00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929997.369185:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369190:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369198:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2e907e4300) 00010000:00010000:3.0:1788929997.369200:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929997.369203:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d772 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369208:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369271:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d764 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104fa expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369299:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d400/0xce4472dd2237d779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104fa expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.369306:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788929997.369309:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788929997.369311:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8677d400, rc 0) 00000100:00100000:3.0:1788929997.369402:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+60:11612:x1875828747101056:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 771us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929997.369410:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 210 00000100:00100000:1.0:1788929997.376457:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929997.376507:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.376602:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747101312 00000100:00100000:0.0:1788929997.376612:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747101312 00000100:00100000:0.0:1788929997.376668:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 211 00000100:00100000:3.0:1788929997.376672:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747101440 00000100:00100000:3.0:1788929997.376676:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747101440 00000100:00100000:0.0:1788929997.376678:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+60:11612:x1875828747101312:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788929997.376696:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929997.376715:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d780 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210501 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929997.376717:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:3.0:1788929997.376724:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:2359:x1875828747101440:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929997.376736:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929997.376754:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d400/0xce4472dd2237d779 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104fa expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.376843:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.376857:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ec expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.376865:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.376904:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ec expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.376930:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ec expref: 62 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929997.376946:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86aea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770158720:192.168.204.40@tcp:104: 00010000:00010000:3.0:1788929997.376954:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788929997.376958:0:7629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.376965:0:7629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.376970:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929997.377167:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311900 going to sleep for 11 seconds 00000100:00100000:3.0:1788929997.377309:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:2359:x1875828747101440:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 584us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929997.377325:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:1.0:1788929997.383339:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.383547:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86aea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770158720:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929997.383580:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929997.383708:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747101568 00000100:00100000:2.0:1788929997.383716:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747101568 00010000:00010000:2.0:1788929997.383754:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ec expref: 61 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929997.383797:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00100000:2.0:1788929997.383806:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:2361:x1875828747101568:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788929997.383822:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929997.383828:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ec expref: 61 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.383838:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ec expref: 61 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.383860:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d74f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402104ec expref: 61 pid: 5840 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.383883:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788929997.383887:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.383897:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.383904:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.383941:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929997.384004:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+60:2361:x1875828747101568:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 198us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929997.384010:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 79 00010000:00010000:0.0:1788929997.384069:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.384077:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929997.384098:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788929997.384299:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d780 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210501 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.384318:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210501 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.384325:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:0.0:1788929997.384327:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788929997.384330:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8000, rc 0) 00000100:00100000:0.0:1788929997.384356:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+60:11612:x1875828747101312:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 7680us (7910us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788929997.384363:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 211 00000100:00100000:1.0:1788929997.397805:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929997.397906:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747101824 00000100:00100000:3.0:1788929997.397927:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747101824 00000100:00100000:3.0:1788929997.397998:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:3.0:1788929997.398008:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+60:11612:x1875828747101824:12345-192.168.204.40@tcp:103:lfs.0 00010000:00010000:3.0:1788929997.398025:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929997.398050:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340000/0xce4472dd2237d6e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104d7 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.398071:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788929997.398076:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929997.398141:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+59:11612:x1875828747101824:12345-192.168.204.40@tcp:103:lfs.0 Request processed in 134us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929997.398148:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:3.0:1788929997.400633:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.400978:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747101952 00000100:00100000:2.0:1788929997.400989:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747101952 00000100:00100000:2.0:1788929997.401053:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 212 00000100:00100000:2.0:1788929997.401063:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+59:11612:x1875828747101952:12345-192.168.204.40@tcp:58:lfs.0 00010000:00010000:2.0:1788929997.401162:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d795 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.401179:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d795 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.401190:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d795 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788929997.401438:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788929997.401645:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+59:11612:x1875828747101952:12345-192.168.204.40@tcp:58:lfs.0 Request processed in 582us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929997.401667:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 212 00000100:00100000:1.0:1788929997.404869:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929997.410494:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747102080 00000100:00100000:3.0:1788929997.410513:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747102080 00000100:00100000:3.0:1788929997.410588:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 213 00000100:00100000:3.0:1788929997.410599:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+59:11612:x1875828747102080:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788929997.410624:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929997.410648:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d79c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210508 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.410717:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d795 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.410728:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d79c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210508 expref: 60 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.411018:0:11024:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d795 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.411036:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d79c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210508 expref: 60 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.411063:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788929997.411066:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788929997.411070:0:11024:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d79c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210508 expref: 60 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.411079:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8677d200, rc 0) 00000100:00100000:3.0:1788929997.411168:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+60:11612:x1875828747102080:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 570us (6314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929997.411174:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 213 00000040:00080000:0.0:1788929997.724066:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788929997.724076:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788929997.724497:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788929997.724507:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788929997.725044:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86aea300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875828770158848:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788929997.725315:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788929997.736258:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.738537:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747102208 00000100:00100000:2.0:1788929997.738552:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747102208 00000100:00100000:2.0:1788929997.738621:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 214 00000100:00100000:2.0:1788929997.738632:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:11613:x1875828747102208:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788929997.738667:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788929997.738800:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:11613:x1875828747102208:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 169us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929997.738808:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 214 00000100:00100000:0.0:1788929997.744849:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86aea300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875828770158848:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788929997.749319:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.749501:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747102336 00000100:00100000:0.0:1788929997.749522:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747102336 00000100:00100000:0.0:1788929997.749586:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 215 00000100:00100000:0.0:1788929997.749596:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+60:11613:x1875828747102336:12345-192.168.204.40@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788929997.750084:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d7a3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.750102:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.750131:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.750148:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.750155:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.750162:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.750185:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d7b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.750194:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.750201:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929997.752049:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788929997.752064:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788929997.752086:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752104:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752111:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d7a3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752136:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752142:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929997.752146:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752153:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d7a3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752167:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:0.0:1788929997.752171:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929997.752176:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d7a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752183:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237d7a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752198:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752204:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7aa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752210:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752216:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929997.752219:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752280:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7aa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752288:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8d2e83038400) 00010000:00010000:0.0:1788929997.752291:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929997.752294:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7aa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752299:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7aa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752316:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752322:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d7b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752327:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752332:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929997.752335:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752340:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d7b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.752347:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:0.0:1788929997.752350:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929997.752353:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d7b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.754946:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237d7b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929997.755075:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+60:11613:x1875828747102336:12345-192.168.204.40@tcp:34:lhsmtool_posix.0 Request processed in 5474us (5760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929997.755085:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 215 00000100:00100000:3.0:1788929997.759819:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.760125:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747102592 00000100:00100000:2.0:1788929997.760136:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747102592 00000100:00100000:2.0:1788929997.760197:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 216 00000100:00100000:2.0:1788929997.760207:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+60:11613:x1875828747102592:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788929997.760268:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929997.760292:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d7b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021050f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.760421:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.760437:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.760448:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929997.760459:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788929997.760590:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.760598:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.760605:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.760611:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929997.760616:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.760623:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.760634:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788929997.760637:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788929997.760643:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.760648:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.760860:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d7b8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021050f expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.760872:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:2.0:1788929997.760874:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788929997.760878:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d7b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021050f expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.760903:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341000, rc 0) 00000100:00100000:2.0:1788929997.760986:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:11613:x1875828747102592:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 780us (1177us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788929997.760995:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 216 00000100:00100000:1.0:1788929997.768945:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929997.770111:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747102720 00000100:00100000:3.0:1788929997.770123:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747102720 00000100:00100000:3.0:1788929997.770189:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 217 00000100:00100000:3.0:1788929997.770200:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:11613:x1875828747102720:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788929997.770267:0:11024:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788929997.770592:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:11613:x1875828747102720:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 393us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929997.770601:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 217 00000100:00100000:0.0:1788929997.775515:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.775615:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747102976 00000100:00100000:2.0:1788929997.775625:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747102976 00000100:00100000:2.0:1788929997.775694:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 218 00000100:00100000:2.0:1788929997.775705:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:11613:x1875828747102976:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788929997.775726:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929997.775730:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788929997.775768:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d000/0xce4472dd2237d75d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402104f3 expref: 61 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.775788:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:2.0:1788929997.775793:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788929997.775806:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d7cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210516 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788929997.776289:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788929997.776499:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.776513:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.776524:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.776594:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d7cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210516 expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.776609:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210516 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.776615:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2e98756c00) 00010000:00010000:2.0:1788929997.776618:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788929997.776620:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340200, rc 0) 00000100:00100000:2.0:1788929997.776680:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+62:11613:x1875828747102976:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 978us (1177us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788929997.776688:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 218 00000100:00100000:1.0:1788929997.780085:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.780183:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747103232 00000100:00100000:0.0:1788929997.780192:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747103232 00000100:00100000:0.0:1788929997.780281:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 219 00000100:00100000:0.0:1788929997.780291:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+62:11613:x1875828747103232:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788929997.780345:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929997.780380:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d7d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210516 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780400:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2e98756c00) 00010000:00010000:0.0:1788929997.780410:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788929997.780430:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780443:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780452:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780465:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc640b5f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780490:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc640b5f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780497:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc640b5f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780556:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780564:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780571:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780577:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929997.780581:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780588:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780596:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:0.0:1788929997.780598:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929997.780602:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780608:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237d7e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780617:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc640b5f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780631:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc640b5f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780636:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc640b5f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780641:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929997.780644:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc640b5f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780651:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc640b5f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780658:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc640b5f3 (ffff8d2e83038400) 00010000:00010000:0.0:1788929997.780660:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788929997.780663:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc640b5f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.780669:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc640b5f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929997.780737:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:11613:x1875828747103232:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 448us (662us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788929997.780744:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 219 00000100:00100000:0.0:1788929997.783550:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.783822:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747103360 00000100:00100000:2.0:1788929997.783832:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747103360 00000100:00100000:2.0:1788929997.783900:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 220 00000100:00100000:2.0:1788929997.783919:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+61:11613:x1875828747103360:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788929997.783939:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929997.783960:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d7f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021051d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.783994:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d7f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.784007:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.784018:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.784119:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d7f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021051d expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.784139:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021051d expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.784148:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2e98756a00) 00010000:00010000:2.0:1788929997.784151:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788929997.784155:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341e00, rc 0) 00000100:00100000:2.0:1788929997.784219:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+62:11613:x1875828747103360:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 310us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929997.784266:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 220 00000100:00100000:1.0:1788929997.792297:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.792430:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747103616 00000100:00100000:0.0:1788929997.792441:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747103616 00000100:00100000:0.0:1788929997.792496:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 221 00000100:00100000:0.0:1788929997.792505:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e863ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+62:11613:x1875828747103616:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788929997.792607:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.792626:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.792639:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788929997.793043:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788929997.793054:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382948829210ns, next at 383948826581ns, rc = 0 00000004:00010000:0.0:1788929997.793144:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a43e922b reply state 00000000c35a71b9 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929997.793154:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788929997.793621:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e863ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+64:11613:x1875828747103616:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 1113us (1332us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788929997.793630:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 221 00010000:00010000:1.0:1788929997.796887:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.796908:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.796943:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.796949:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929997.796955:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.796963:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.796982:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2e98756a00) 00010000:00010000:1.0:1788929997.796990:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788929997.796997:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.797003:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9800/0xce4472dd2237d7fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929997.800895:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.801054:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747103744 00000100:00100000:2.0:1788929997.801064:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747103744 00000100:00100000:2.0:1788929997.801126:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 222 00000100:00100000:2.0:1788929997.801138:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+63:11613:x1875828747103744:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788929997.801164:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929997.801186:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d805 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210524 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.801276:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d805 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210524 expref: 64 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.801292:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d805 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210524 expref: 64 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.801326:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2e98756a00) 00010000:00010000:2.0:1788929997.801330:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788929997.801334:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341400, rc 0) 00000100:00100000:2.0:1788929997.801417:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+64:11613:x1875828747103744:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 281us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929997.801424:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 222 00000100:00100000:3.0:1788929997.804636:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.804730:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747103872 00000100:00100000:0.0:1788929997.804739:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747103872 00000100:00100000:0.0:1788929997.804802:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:0.0:1788929997.804811:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2362:x1875828747103872:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788929997.805117:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:2362:x1875828747103872:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 Request processed in 305us (491us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788929997.805125:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:3.0:1788929997.807830:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.807905:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747104128 00000100:00100000:2.0:1788929997.807926:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747104128 00000100:00100000:2.0:1788929997.807984:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 60 00000100:00100000:2.0:1788929997.807994:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+64:11613:x1875828747104128:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788929997.808267:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+65:11613:x1875828747104128:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 273us (445us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788929997.808274:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 60 00000100:00100000:1.0:1788929997.810790:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.811176:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747104384 00000100:00100000:2.0:1788929997.811186:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747104384 00000100:00100000:2.0:1788929997.811284:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 223 00000100:00100000:2.0:1788929997.811294:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+65:11613:x1875828747104384:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788929997.811417:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+65:11613:x1875828747104384:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 124us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929997.811424:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 223 00000100:00100000:3.0:1788929997.813930:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.814087:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747104512 00000100:00100000:2.0:1788929997.814096:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747104512 00000100:00100000:2.0:1788929997.814150:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 224 00000100:00100000:2.0:1788929997.814161:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+65:11613:x1875828747104512:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788929997.814197:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788929997.814219:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d80c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021052b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.814342:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d813 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.814356:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.814379:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929997.814418:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788929997.814439:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.814467:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237d80c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021052b expref: 67 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.814485:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021052b expref: 66 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.814493:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2e98756a00) 00010000:00010000:2.0:1788929997.814496:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788929997.814500:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341200, rc 0) 00000100:00100000:2.0:1788929997.814550:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+66:11613:x1875828747104512:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 391us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929997.814557:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 224 00000100:00100000:3.0:1788929997.817890:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.818010:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747104640 00000100:00100000:0.0:1788929997.818020:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747104640 00000100:00100000:0.0:1788929997.818075:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:0.0:1788929997.818100:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+10:2361:x1875828747104640:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788929997.818117:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929997.818136:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea8826bd/0xce4472dd2237d81a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210532 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788929997.818162:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0e7cc, blocks: 0x1 00010000:00010000:0.0:1788929997.818182:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1788929997.818186:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929997.818195:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8826bd/0xce4472dd2237d81a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210532 expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.818212:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea8826bd/0xce4472dd2237d81a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210532 expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.818265:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9c00, rc 0) 00000100:00100000:0.0:1788929997.818315:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+11:2361:x1875828747104640:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 217us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929997.818322:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:1.0:1788929997.821260:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.821350:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747104896 00000100:00100000:2.0:1788929997.821370:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747104896 00000100:00100000:2.0:1788929997.821427:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 225 00000100:00100000:2.0:1788929997.821437:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+66:11613:x1875828747104896:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788929997.821547:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+66:11613:x1875828747104896:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 112us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929997.821555:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 225 00000100:00100000:1.0:1788929997.826578:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929997.826697:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747105024 00000100:00100000:3.0:1788929997.826708:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747105024 00000100:00100000:3.0:1788929997.826763:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:3.0:1788929997.826773:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+11:11613:x1875828747105024:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788929997.826792:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788929997.826813:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fd9fdb5/0xce4472dd2237d821 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210539 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.826846:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea8826bd/0xce4472dd2237d81a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210532 expref: 12 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.826855:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788929997.826859:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788929997.826864:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fd9fdb5/0xce4472dd2237d821 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210539 expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.826897:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea8826bd/0xce4472dd2237d81a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210532 expref: 12 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.826922:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea8826bd/0xce4472dd2237d81a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210532 expref: 12 pid: 6685 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929997.826937:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb536a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875828770158976:192.168.204.40@tcp:104: 00000100:00100000:3.0:1788929997.827031:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d7180 going to sleep for 11 seconds 00000100:00100000:0.0:1788929997.829731:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb536a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875828770158976:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929997.829785:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003fd9fdb5/0xce4472dd2237d821 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210539 expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.829808:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8677d400, rc 0) 00000100:00100000:0.0:1788929997.829887:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+12:11613:x1875828747105024:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 3114us (3318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929997.829918:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:1.0:1788929997.838786:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.838903:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747105152 00000100:00100000:2.0:1788929997.838925:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747105152 00010000:00010000:2.0:1788929997.838974:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8826bd/0xce4472dd2237d81a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210532 expref: 12 pid: 6685 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929997.839022:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:2.0:1788929997.839032:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e881fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+12:2362:x1875828747105152:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788929997.839047:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929997.839072:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea8826bd/0xce4472dd2237d81a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210532 expref: 12 pid: 6685 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.839086:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea8826bd/0xce4472dd2237d81a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210532 expref: 12 pid: 6685 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.839112:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea8826bd/0xce4472dd2237d81a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210532 expref: 12 pid: 6685 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.839131:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929997.839136:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788929997.839164:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003fd9fdb5/0xce4472dd2237d821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210539 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.839174:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fd9fdb5/0xce4472dd2237d821 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210539 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.839217:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003fd9fdb5/0xce4472dd2237d821 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210539 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929997.839300:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1875828770159104:192.168.204.40@tcp:105: 00000100:00100000:2.0:1788929997.839590:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e22c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788929997.844764:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929997.844864:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747105280 00000100:00100000:1.0:1788929997.844875:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747105280 00002000:00100000:1.0:1788929997.844937:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8d2d86ae8380 x1875828747105280/t0(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:543/0 lens 504/0 e 0 to 0 dl 1788930008 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788929997.844950:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2d86ae8380 with x1875828747105280 ext(0->12) 00002000:00010000:1.0:1788929997.844957:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2d86ae8380 00000100:00100000:1.0:1788929997.845000:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:1.0:1788929997.845009:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+12:2362:x1875828747105280:12345-192.168.204.40@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788929997.845557:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:2362:x1875828747105280:12345-192.168.204.40@tcp:4:lhsmtool_posix.0 Request processed in 547us (802us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788929997.845567:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00002000:00100000:1.0:1788929997.845574:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8d2d86ae8380 x1875828747105280/t4294967320(0) o4->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:543/0 lens 504/448 e 0 to 0 dl 1788930008 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788929997.845583:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2d86ae8380 with x1875828747105280 ext(0->12) 00002000:00010000:1.0:1788929997.845587:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2d86ae8380 00000100:00100000:2.0:1788929997.851106:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1875828770159104:192.168.204.40@tcp:105: 00010000:00010000:2.0:1788929997.851136:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929997.851218:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e881fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:2362:x1875828747105152:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 12186us (12440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929997.851247:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:0.0:1788929997.855916:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.856214:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747105408 00000100:00100000:2.0:1788929997.856260:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747105408 00000100:00100000:2.0:1788929997.856319:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 226 00000100:00100000:2.0:1788929997.856334:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+66:11613:x1875828747105408:12345-192.168.204.40@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788929997.911893:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1788929997.911920:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000020:00080000:1.0:1788929997.911971:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2e9acd4300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788929997.911976:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2eb5396f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2e9acd4cc0 00000020:00080000:1.0:1788929997.911979:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2eb5396b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2ebcb65000 00000004:00080000:1.0:1788929997.912004:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788929997.912019:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2d8773e6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788929997.912036:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2e86215300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2d8773e240 00000020:00080000:1.0:1788929997.912039:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2e86215500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2e881a3800 00000004:00080000:1.0:1788929997.912057:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:1.0:1788929997.912071:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1788929997.912362:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788929997.912548:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788929997.912581:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770159232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788929997.912647:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929997.912687:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929997.912694:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770159360:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788929997.912717:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929997.912743:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788929997.912763:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770159488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788929997.912787:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929997.912817:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770159232 00000100:00100000:0.0:1788929997.912824:0:12006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770159232 00000100:00100000:0.0:1788929997.912877:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770159360 00000100:00100000:0.0:1788929997.912880:0:12006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770159360 00000100:00100000:0.0:1788929997.912928:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770159488 00000100:00100000:0.0:1788929997.912931:0:12006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770159488 00000100:00100000:0.0:1788929997.912948:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788929997.912957:0:12006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3310:x1875828770159232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788929997.912985:0:12006:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1788929997.913020:0:12006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa0e7cb, atime: 0x6aa0e7cb, ctime: 0x6aa0e7cb, blocks: 0x1 00010000:00010000:0.0:1788929997.913028:0:12006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2396c14/0xce4472dd2237d828 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.913046:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1788929997.913060:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788929997.913067:0:12006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2396c14/0xce4472dd2237d828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.913084:0:12006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2396c14/0xce4472dd2237d828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.913095:0:12006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2396c14/0xce4472dd2237d828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.913104:0:12006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2396c14/0xce4472dd2237d828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.913123:0:12006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788929997.914047:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:11613:x1875828747105408:12345-192.168.204.40@tcp:44:lhsmtool_posix.0 Request processed in 57713us (58142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929997.914057:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 226 00000100:00100000:0.0:1788929997.914218:0:12006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3310:x1875828770159232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1261us (1570us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788929997.914259:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788929997.914277:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788929997.914287:0:12006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3310:x1875828770159360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788929997.914307:0:12006:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788929997.914327:0:12006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.914344:0:12006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237d5ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210498 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.914354:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788929997.914368:0:12006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929997.914373:0:12006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.914405:0:12006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237d5ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210498 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.914421:0:12006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237d5ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210498 expref: 12 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929997.914437:0:12006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12006:1875828770159616:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929997.914491:0:12006:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311240 going to sleep for 11 seconds 00000100:00100000:0.0:1788929997.914514:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788929997.914522:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875828770159488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788929997.919330:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788929997.919339:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788929996 00002000:00010000:0.0:1788929997.919342:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788929997.919344:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788929996 -> 1788929996 00002000:00010000:0.0:1788929997.919345:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788929997.919437:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3309:x1875828770159488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4911us (6644us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788929997.919449:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788929997.919500:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788929997.919515:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788929997.919523:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2396c14/0xce4472dd2237d828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.919864:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788929997.919870:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2396c14/0xce4472dd2237d828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.919883:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2396c14/0xce4472dd2237d828 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.919905:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2396c14/0xce4472dd2237d828 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.919925:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2396c14/0xce4472dd2237d828 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.919947:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929997.919949:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929997.919951:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788929997.919990:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2d86aeb800/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788929997.919997:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770159488:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1788929997.920075:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2eb5a3ea00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788929997.920080:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770159232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788929997.924027:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929997.924202:0:12006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12006:1875828770159616:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788929997.924255:0:12006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929997.924649:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747105536 00000100:00100000:0.0:1788929997.924658:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747105536 00000100:00100000:0.0:1788929997.924711:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 69 00000100:00100000:0.0:1788929997.924721:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:2362:x1875828747105536:12345-192.168.204.40@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788929997.927194:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929997.927348:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747105664 00000100:00100000:3.0:1788929997.927358:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747105664 00010000:00010000:3.0:1788929997.927400:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237d5ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210498 expref: 14 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929997.927490:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:3.0:1788929997.927501:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+14:2361:x1875828747105664:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929997.927517:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929997.927524:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237d5ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210498 expref: 14 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.927540:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237d5ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210498 expref: 14 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.927576:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237d5ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210498 expref: 14 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.927594:0:7629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788929997.927598:0:7629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788929997.927604:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.927613:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.927661:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929997.927712:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+13:2361:x1875828747105664:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 213us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929997.927720:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 81 00010000:00010000:2.0:1788929997.931705:0:12006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.931727:0:12006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.931740:0:12006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.931748:0:12006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929997.931772:0:12006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788929997.932147:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788929997.932154:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.932163:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788929997.932167:0:7628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.932178:0:7628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.932200:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.932208:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237d82f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.932242:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929997.932244:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788929997.932253:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929997.932422:0:12006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3310:x1875828770159360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18133us (19698us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788929997.932432:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1788929997.933114:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2d86aeb480/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788929997.933124:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770159360:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788929997.967367:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+12:2362:x1875828747105536:12345-192.168.204.40@tcp:16:lhsmtool_posix.0 Request processed in 42624us (43326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929997.967404:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 69 00000001:00080000:3.0:1788929997.968640:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1788929997.968656:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:3.0:1788929997.968664:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1788929997.970364:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929997.970495:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747105920 00000100:00100000:1.0:1788929997.970504:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747105920 00000100:00100000:1.0:1788929997.970654:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 227 00000100:00100000:1.0:1788929997.970665:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:11613:x1875828747105920:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788929997.970724:0:11024:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788929997.970765:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237d813 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021052b expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.970788:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2e98756a00) 00010000:00010000:1.0:1788929997.970793:0:11024:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788929997.970839:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d836 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.970853:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.970862:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788929997.971113:0:11024:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000151b3768 reply state 0000000031aff056 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929997.971124:0:11024:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788929997.971259:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:11613:x1875828747105920:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 558us (875us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788929997.971268:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 227 00000100:00100000:3.0:1788929997.974158:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00010000:3.0:1788929997.974197:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.974208:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d836 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.974216:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d836 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.974248:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788929997.974254:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d836 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.974262:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d836 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.974278:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2e98756a00) 00010000:00010000:3.0:1788929997.974281:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788929997.974286:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d836 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.974309:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d836 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929997.975089:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747106048 00000100:00100000:0.0:1788929997.975100:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747106048 00000100:00100000:0.0:1788929997.975210:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 70 00000100:00100000:0.0:1788929997.975248:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747106048:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788929997.975508:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788929997.975512:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788929996 -> 1788929996 00002000:00010000:0.0:1788929997.975514:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788929995 00002000:00010000:0.0:1788929997.975516:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788929996 -> 1788929996 00002000:00010000:0.0:1788929997.975518:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788929997.975592:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2361:x1875828747106048:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 Request processed in 372us (1443us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788929997.975599:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 70 00000100:00100000:3.0:1788929997.978136:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929997.978213:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747106304 00000100:00100000:1.0:1788929997.978255:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747106304 00000100:00100000:1.0:1788929997.978308:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 228 00000100:00100000:1.0:1788929997.978318:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:11613:x1875828747106304:12345-192.168.204.40@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788929997.978406:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.978424:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d7f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021051d expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.978433:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.978469:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021051d expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.978484:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d7f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021051d expref: 20 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929997.978498:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875828770159744:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929997.978583:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788929997.981667:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1875828770159744:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929997.981698:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929997.982777:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929997.983128:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747106432 00000100:00100000:3.0:1788929997.983138:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747106432 00010000:00010000:3.0:1788929997.983187:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d7f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021051d expref: 21 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929997.983251:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00100000:3.0:1788929997.983262:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:2362:x1875828747106432:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929997.983278:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929997.983285:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d7f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021051d expref: 21 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.983298:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021051d expref: 21 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.983323:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237d7f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021051d expref: 21 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.983341:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2e98756a00) 00010000:00010000:3.0:1788929997.983347:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.983359:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.983397:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.983425:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788929997.983484:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:2362:x1875828747106432:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 224us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929997.983492:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 82 00010000:00010000:1.0:1788929997.984337:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.984378:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.984412:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.984419:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.984426:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.984432:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929997.984436:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.984443:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.984455:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2e98756a00) 00010000:00010000:1.0:1788929997.984458:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788929997.984461:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929997.984467:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153800/0xce4472dd2237d83d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929997.984530:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:11613:x1875828747106304:12345-192.168.204.40@tcp:55:lhsmtool_posix.0 Request processed in 6211us (6401us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788929997.984540:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 228 00000100:00100000:3.0:1788929997.986640:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.987348:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747106560 00000100:00100000:0.0:1788929997.987364:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747106560 00000100:00100000:0.0:1788929997.987410:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 71 00000100:00100000:0.0:1788929997.987420:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2361:x1875828747106560:12345-192.168.204.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788929997.987470:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.987490:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003fd9fdb5/0xce4472dd2237d821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210539 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.987499:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788929997.987515:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929997.987520:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.987561:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003fd9fdb5/0xce4472dd2237d821 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210539 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.987575:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003fd9fdb5/0xce4472dd2237d821 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210539 expref: 8 pid: 6688 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929997.987591:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875828770159872:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929997.987689:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89077900 going to sleep for 11 seconds 00000100:00100000:0.0:1788929997.990819:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875828770159872:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929997.990852:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929997.992531:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.992840:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747106688 00000100:00100000:0.0:1788929997.992849:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747106688 00010000:00010000:0.0:1788929997.992888:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003fd9fdb5/0xce4472dd2237d821 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210539 expref: 9 pid: 6688 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929997.992946:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:0.0:1788929997.992967:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+9:2361:x1875828747106688:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929997.992983:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929997.993005:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003fd9fdb5/0xce4472dd2237d821 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210539 expref: 9 pid: 6688 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.993039:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003fd9fdb5/0xce4472dd2237d821 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210539 expref: 9 pid: 6688 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.993062:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fd9fdb5/0xce4472dd2237d821 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210539 expref: 9 pid: 6688 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.993079:0:7629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929997.993083:0:7629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788929997.993089:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.993099:0:7629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929997.993134:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929997.993189:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2361:x1875828747106688:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 234us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929997.993197:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 83 00010000:00010000:3.0:1788929997.993460:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.993470:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.993496:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.993505:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.993513:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.993519:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788929997.993524:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.993541:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.993555:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929997.993563:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2396c14/0xce4472dd2237d844 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929997.993626:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2361:x1875828747106560:12345-192.168.204.40@tcp:1:lhsmtool_posix.0 Request processed in 6207us (6996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929997.993633:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 71 00000100:00100000:3.0:1788929997.999736:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929997.999921:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747106944 00000100:00100000:0.0:1788929997.999944:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747106944 00000100:00100000:0.0:1788929998.000021:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 229 00000100:00100000:0.0:1788929998.000032:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:11613:x1875828747106944:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788929998.000114:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d84b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.000132:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d84b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.000161:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d84b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.000454:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.000469:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d805 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210524 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.000478:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.000512:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d805 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210524 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.000525:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d805 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210524 expref: 20 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929998.000540:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770160000:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788929998.000630:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89077900 going to sleep for 11 seconds 00000100:00100000:1.0:1788929998.006353:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929998.006520:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770160000:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788929998.006552:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929998.007378:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747107072 00000100:00100000:3.0:1788929998.007388:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747107072 00010000:00010000:3.0:1788929998.007436:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d805 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210524 expref: 21 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788929998.007479:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:3.0:1788929998.007489:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:2361:x1875828747107072:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788929998.007504:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788929998.007512:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d805 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210524 expref: 21 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929998.007525:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d805 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210524 expref: 21 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929998.007565:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237d805 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210524 expref: 21 pid: 5841 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929998.007582:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2e98756a00) 00010000:00010000:3.0:1788929998.007587:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929998.007597:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929998.007604:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788929998.007636:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788929998.007774:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.007783:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788929998.008033:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1788929998.008187:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788929998.008270:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1788929998.008354:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875828770160128:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788929998.008411:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929998.008450:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770160128 00000100:00100000:0.0:1788929998.008454:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770160128 00000100:00100000:0.0:1788929998.008490:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788929998.008498:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1875828770160128:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788929998.008561:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1875828770160128:12345-0@lo:1000:mdt00_000.0 Request processed in 63us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929998.008568:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788929998.008594:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e890770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788929998.008612:0:5839:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1788929998.008616:0:5839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1788929998.008632:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2d86aeb800, transno 4294967321 00000100:00100000:0.0:1788929998.008645:0:5839:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d2d86aeb480 x1875828770159360/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788930013 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788929998.008656:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875828770160128:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788929998.009285:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788929998.009361:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875828770160256:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788929998.009392:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929998.009422:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770160256 00000100:00100000:0.0:1788929998.009427:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770160256 00000100:00100000:0.0:1788929998.009454:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788929998.009463:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1875828770160256:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788929998.009641:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5839:x1875828770160256:12345-0@lo:1000:mdt00_000.0 Request processed in 179us (248us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788929998.009650:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788929998.009672:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89077900 going to sleep for 11 seconds 00000100:00100000:0.0:1788929998.009694:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5e31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5839:1875828770160256:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788929998.009725:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009734:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009742:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009748:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929998.009753:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009762:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009776:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2e98756a00) 00010000:00010000:0.0:1788929998.009779:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788929998.009784:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009790:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d852 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009819:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d795 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009832:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d795 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009838:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d795 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009844:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788929998.009847:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d795 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009852:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d795 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009861:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:0.0:1788929998.009864:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788929998.009870:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d79c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210508 expref: 24 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009881:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d79c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210508 expref: 24 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009891:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d79c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210508 expref: 24 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.009929:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d79c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210508 expref: 24 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929998.009941:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86ae8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770160384:192.168.204.40@tcp:105: 00000100:00100000:3.0:1788929998.010663:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:2361:x1875828747107072:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 3171us (4317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929998.010674:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:0.0:1788929998.012021:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89077900 going to sleep for 11 seconds 00000100:00100000:3.0:1788929998.018978:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929998.019155:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747107200 00000100:00100000:2.0:1788929998.019165:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747107200 00000100:00100000:2.0:1788929998.019251:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:2.0:1788929998.019264:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb536a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:11612:x1875828747107200:12345-192.168.204.40@tcp:49:lfs.0 00000100:00100000:2.0:1788929998.019408:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb536a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+24:11612:x1875828747107200:12345-192.168.204.40@tcp:49:lfs.0 Request processed in 147us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929998.019416:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:1.0:1788929998.019655:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86ae8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1875828770160384:192.168.204.40@tcp:105: 00010000:00010000:1.0:1788929998.019686:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d795 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019698:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340800/0xce4472dd2237d795 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019745:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d859 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019772:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d859 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019785:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d859 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019795:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d859 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019801:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d859 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019806:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d859 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019812:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929998.019815:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d859 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019822:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d859 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019853:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:1.0:1788929998.019856:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788929998.019860:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d859 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019866:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d859 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019878:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d84b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019884:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d84b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019890:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d84b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019895:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788929998.019898:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d84b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019903:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d84b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019922:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:1.0:1788929998.019924:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788929998.019927:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d84b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.019932:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d84b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929998.020145:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:11613:x1875828747106944:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 20114us (20419us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788929998.020153:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 229 00000020:00080000:1.0:1788929998.020157:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788929998.020443:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788929998.020452:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788929998.020946:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788929998.020963:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788929998.024672:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929998.027214:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747107456 00000100:00100000:2.0:1788929998.027258:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747107456 00000100:00100000:2.0:1788929998.027325:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 230 00000100:00100000:2.0:1788929998.027336:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:11612:x1875828747107456:12345-192.168.204.40@tcp:58:lfs.0 00000040:00080000:2.0:1788929998.027768:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788929998.027874:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:11612:x1875828747107456:12345-192.168.204.40@tcp:58:lfs.0 Request processed in 539us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929998.027884:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 230 00000100:00100000:3.0:1788929998.029525:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929998.031109:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747107712 00000100:00100000:2.0:1788929998.031123:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747107712 00000100:00100000:2.0:1788929998.031193:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:2.0:1788929998.031204:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90953850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+23:11613:x1875828747107712:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788929998.034341:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788929998.034540:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788929998.034612:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d860 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.034628:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.034640:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.034649:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d860 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.034655:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d860 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.034669:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d860 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.034688:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788929998.034782:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90953850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+25:11613:x1875828747107712:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 3576us (5262us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788929998.034792:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 62 00000020:00080000:2.0:1788929998.034808:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788929998.035573:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788929998.035582:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d860 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.035590:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788929998.035594:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d860 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.035602:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d860 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.035616:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2e98756800) 00010000:00010000:0.0:1788929998.035619:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788929998.035624:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d860 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.035631:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237d860 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.035651:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929998.035653:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788929998.035655:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788929998.084978:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929998.085359:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747107840 00000100:00100000:1.0:1788929998.085369:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747107840 00000100:00100000:1.0:1788929998.085435:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 231 00000100:00100000:1.0:1788929998.085445:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+25:11615:x1875828747107840:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788929998.085473:0:11024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788929998.085496:0:11024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d867 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210540 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.085562:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d86e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.085578:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d86e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.085590:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d86e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.085605:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d875 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.085612:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.085619:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.085878:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d87c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.085890:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210501 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.085899:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d87c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.085965:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210501 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788929998.085983:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210501 expref: 26 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788929998.085998:0:11024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770160512:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788929998.086095:0:11024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788929998.092706:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788929998.092815:0:11024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11024:1875828770160512:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788929998.092846:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d87c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929998.093675:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747108096 00000100:00100000:0.0:1788929998.093685:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747108096 00000100:00100000:0.0:1788929998.093749:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:0.0:1788929998.093768:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:5599:x1875828747108096:12345-192.168.204.40@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788929998.095187:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+28:5599:x1875828747108096:12345-192.168.204.40@tcp:35:ldlm_bl.0 Request processed in 1413us (2484us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788929998.095199:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:2.0:1788929998.098140:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929998.098498:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747108224 00000100:00100000:0.0:1788929998.098509:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747108224 00010000:00010000:0.0:1788929998.098551:0:7629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210501 expref: 28 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788929998.098616:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 85 00000100:00100000:0.0:1788929998.098626:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+28:2361:x1875828747108224:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788929998.098643:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788929998.098651:0:7629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210501 expref: 28 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.098665:0:7629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210501 expref: 28 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.098687:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d787 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210501 expref: 28 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.098703:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:0.0:1788929998.098709:0:7629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d87c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.098717:0:7629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d87c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.098725:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d87c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929998.098870:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788929998.099043:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:2361:x1875828747108224:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 416us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929998.099052:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 85 00010000:00010000:2.0:1788929998.101125:0:11024:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d87c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101142:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d87c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788929998.101189:0:11024:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788929998.101193:0:11024:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788929998.101215:0:11024:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d87c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101440:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d87c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101452:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d86e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101459:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d86e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101466:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d86e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101491:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929998.101495:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d86e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101504:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d86e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101521:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:2.0:1788929998.101524:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929998.101530:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d86e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101536:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152400/0xce4472dd2237d86e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101555:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101560:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d875 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101565:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101571:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929998.101574:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101580:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d875 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101598:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2eb85fd200) 00010000:00010000:2.0:1788929998.101600:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788929998.101604:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d875 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101609:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152c00/0xce4472dd2237d875 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101651:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152e00/0xce4472dd2237d867 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210540 expref: 27 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101666:0:11024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d87c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210540 expref: 26 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929998.101673:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788929998.101676:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788929998.101679:0:11024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153c00, rc 0) 00000100:00100000:2.0:1788929998.101814:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:11615:x1875828747107840:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 16369us (16844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929998.101974:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 231 00010000:00010000:2.0:1788929998.246640:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788929998.811674:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770161024:0@lo:400:kworker.0 00000100:00100000:2.0:1788929998.811693:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770160768:0@lo:400:kworker.0 00000100:00100000:2.0:1788929998.812418:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929998.812442:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770160640:0@lo:400:kworker.0 00000100:00100000:2.0:1788929998.812496:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788929998.812499:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788929998.812502:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770160896:0@lo:400:kworker.0 00000100:00100000:2.0:1788929998.812526:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929998.812549:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770160640 00000100:00100000:0.0:1788929998.812557:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770160640 00000100:00100000:0.0:1788929998.812602:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788929998.812612:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770160640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929998.812682:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770160768 00000100:00100000:0.0:1788929998.812686:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3309:x1875828770160640:12345-0@lo:400:kworker.0 Request processed in 75us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929998.812687:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770160768 00000100:00100000:0.0:1788929998.812693:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788929998.812714:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770160896 00000100:00100000:3.0:1788929998.812717:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770160896 00000100:00100000:0.0:1788929998.812726:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788929998.812733:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770160768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788929998.812742:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788929998.812747:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770160896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929998.812767:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770160768:12345-0@lo:400:kworker.0 Request processed in 36us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929998.812774:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788929998.812782:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770160896:12345-0@lo:400:kworker.0 Request processed in 36us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929998.812789:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1788929998.812790:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929998.812820:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770160896:0@lo:400:kworker.0 00000100:00100000:0.0:1788929998.812831:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770160768:0@lo:400:kworker.0 00000100:00100000:2.0:1788929998.812860:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770160640:0@lo:400:kworker.0 00000100:00100000:1.0:1788929998.813900:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788929998.814054:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770161024 00000100:00100000:0.0:1788929998.814062:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770161024 00000100:00100000:0.0:1788929998.814125:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788929998.814133:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770161024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788929998.814256:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770161024:12345-0@lo:400:kworker.0 Request processed in 123us (370us total) trans 0 rc 0/0 00000100:00080000:2.0:1788929998.814263:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788929998.814265:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788929998.814356:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770161024:0@lo:400:kworker.0 00000040:00080000:2.0:1788929999.046935:0:12556:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788929999.046947:0:12556:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788929999.046994:0:12556:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788929999.047000:0:12556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788929999.067431:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788929999.067439:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788929999.067473:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788929999.067478:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788929999.067605:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cced80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875828770161152:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788929999.067713:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2ebc28d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788929999.089150:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929999.089190:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747108352 00000100:00100000:0.0:1788929999.089209:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747108352 00000100:00100000:0.0:1788929999.089282:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 232 00000100:00100000:0.0:1788929999.089303:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:11626:x1875828747108352:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788929999.089343:0:11024:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788929999.089445:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+27:11626:x1875828747108352:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 154us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788929999.089452:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 232 00000100:00080000:0.0:1788929999.089471:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788929999.091175:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cced80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1875828770161152:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788929999.121784:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788929999.121847:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747108608 00000100:00100000:0.0:1788929999.121859:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747108608 00000100:00100000:0.0:1788929999.121931:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 233 00000100:00100000:0.0:1788929999.121941:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+26:11626:x1875828747108608:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788929999.121967:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788929999.121992:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d883 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210547 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929999.122112:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d88a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929999.122132:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d88a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929999.122146:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d88a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788929999.122159:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788929999.122334:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237d883 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210547 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929999.122373:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d88a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210547 expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788929999.122381:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:0.0:1788929999.122383:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788929999.122387:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8000, rc 0) 00000100:00100000:0.0:1788929999.122455:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+28:11626:x1875828747108608:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 514us (680us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788929999.122462:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 233 00000100:00100000:3.0:1788929999.138730:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929999.139163:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747108864 00000100:00100000:2.0:1788929999.139175:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747108864 00000100:00100000:2.0:1788929999.139258:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 234 00000100:00100000:2.0:1788929999.139268:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+28:11626:x1875828747108864:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788929999.139368:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d898 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929999.139386:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929999.139397:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929999.139586:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929999.139594:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d898 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929999.139627:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d898 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929999.139633:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788929999.139637:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d898 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929999.139645:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d898 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929999.139657:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788929999.139660:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788929999.139665:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d898 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929999.139671:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237d898 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788929999.139822:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:11626:x1875828747108864:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 554us (1103us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788929999.139831:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 234 00000040:00080000:2.0:1788929999.140057:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788929999.140062:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788929999.140567:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788929999.140575:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788929999.150664:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788929999.151574:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747108992 00000100:00100000:2.0:1788929999.151595:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747108992 00000100:00100000:2.0:1788929999.151704:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:2.0:1788929999.151720:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:2362:x1875828747108992:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788929999.151763:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788929999.151798:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237d88a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210547 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788929999.151822:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788929999.151828:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788929999.151914:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+28:2362:x1875828747108992:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 200us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788929999.151922:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:2.0:1788929999.161040:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788929999.161102:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747109248 00000100:00100000:3.0:1788929999.161112:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747109248 00000100:00100000:3.0:1788929999.161172:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:3.0:1788929999.161182:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+28:11626:x1875828747109248:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788929999.161818:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:11626:x1875828747109248:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 633us (782us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788929999.161827:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 64 00010000:00010000:3.0:1788929999.266266:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788929999.324808:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770161280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788929999.324898:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788929999.325418:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770161280 00000100:00100000:3.0:1788929999.325427:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770161280 00000100:00100000:3.0:1788929999.325493:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788929999.325504:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875828770161280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788929999.325545:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788929999.325601:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875828770161280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788929999.325617:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788929999.325669:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770161280:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788929999.325734:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788930000.287611:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930000.859969:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788930000.859999:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770161408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788930000.860091:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930000.860180:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770161408 00000100:00100000:0.0:1788930000.860188:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770161408 00000100:00100000:0.0:1788930000.860281:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788930000.860293:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875828770161408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788930000.860339:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788930000.860391:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875828770161408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930000.860399:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788930000.860420:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788930000.860471:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770161408:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788930000.940378:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788930000.940411:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:2.0:1788930000.950812:0:12608:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788930000.950822:0:12608:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788930000.950881:0:12608:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788930000.950887:0:12608:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788930001.171886:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930001.171978:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747109504 00000100:00100000:0.0:1788930001.171991:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747109504 00000100:00100000:0.0:1788930001.172080:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 235 00000100:00100000:0.0:1788930001.172090:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+29:11648:x1875828747109504:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788930001.172114:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930001.172133:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d89f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021054e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930001.172271:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d8a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930001.172288:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d8a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930001.172314:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d8a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788930001.172327:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788930001.172474:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8e00/0xce4472dd2237d89f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021054e expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930001.172492:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d8a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021054e expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930001.172500:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:0.0:1788930001.172503:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788930001.172507:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9000, rc 0) 00000100:00100000:0.0:1788930001.172564:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:11648:x1875828747109504:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 476us (690us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788930001.172586:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 235 00000100:00080000:2.0:1788930001.173193:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930001.177646:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930001.177748:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747109632 00000100:00100000:1.0:1788930001.177759:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747109632 00000100:00100000:1.0:1788930001.177825:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 236 00000100:00100000:1.0:1788930001.177835:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:11648:x1875828747109632:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:1.0:1788930001.177917:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d8b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930001.177934:0:11024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930001.177946:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930001.177973:0:11024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930001.177981:0:11024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d8b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930001.177988:0:11024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930001.177994:0:11024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930001.177998:0:11024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930001.178005:0:11024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d8b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930001.178035:0:11024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:1.0:1788930001.178038:0:11024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788930001.178044:0:11024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d8b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930001.178050:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152600/0xce4472dd2237d8b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11024 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930001.178126:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:11648:x1875828747109632:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 290us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930001.178133:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 236 00000040:00080000:2.0:1788930001.185526:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788930001.185537:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788930001.185568:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788930001.185574:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788930001.300580:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930001.302661:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747109760 00000100:00100000:2.0:1788930001.302678:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747109760 00000100:00100000:2.0:1788930001.302786:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 72 00000100:00100000:2.0:1788930001.302797:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2362:x1875828747109760:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:2.0:1788930001.302816:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930001.302860:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c81fb88e/0xce4472dd2237d8bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210555 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788930001.302891:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa0e7cc, atime: 0x6aa0e7cb, ctime: 0x6aa0e7cc, blocks: 0xb 00010000:00010000:2.0:1788930001.302915:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1788930001.302919:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930001.302929:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c81fb88e/0xce4472dd2237d8bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210555 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930001.302964:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c81fb88e/0xce4472dd2237d8bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210555 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930001.302977:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341000, rc 0) 00000100:00080000:3.0:1788930001.303102:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788930001.303878:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2362:x1875828747109760:12345-192.168.204.40@tcp:101:cat.0 Request processed in 1077us (3303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930001.303888:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 72 00010000:00010000:0.0:1788930001.309669:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930001.318001:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930001.319329:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747109888 00000100:00100000:3.0:1788930001.319348:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747109888 00002000:00100000:3.0:1788930001.319434:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8d2d86da8380 x1875828747109888/t0(0) o3->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:547/0 lens 488/0 e 0 to 0 dl 1788930012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788930001.319446:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2d86da8380 with x1875828747109888 ext(0->4095) 00002000:00010000:3.0:1788930001.319453:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2d86da8380 00000100:00100000:3.0:1788930001.319491:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:3.0:1788930001.319502:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2360:x1875828747109888:12345-192.168.204.40@tcp:3:cat.0 00000100:00100000:3.0:1788930001.319745:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+8:2360:x1875828747109888:12345-192.168.204.40@tcp:3:cat.0 Request processed in 244us (1755us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788930001.319753:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00002000:00100000:3.0:1788930001.319761:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8d2d86da8380 x1875828747109888/t0(0) o3->668b9f78-1e26-4a12-8f20-ad475b3553ba@192.168.204.40@tcp:547/0 lens 488/4536 e 0 to 0 dl 1788930012 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788930001.319768:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2d86da8380 with x1875828747109888 ext(0->4095) 00002000:00010000:3.0:1788930001.319771:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2d86da8380 00000100:00100000:2.0:1788930001.375326:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930001.375357:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930001.375395:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930001.375677:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747110144 00000100:00100000:3.0:1788930001.375699:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747110144 00000100:00100000:3.0:1788930001.375763:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747110400 00000100:00100000:3.0:1788930001.375767:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747110400 00000100:00100000:3.0:1788930001.375816:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 163 00000100:00100000:3.0:1788930001.375827:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:2361:x1875828747110144:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930001.375864:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747110016 00000100:00100000:1.0:1788930001.375870:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747110016 00000100:00100000:1.0:1788930001.375905:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 298 00000100:00100000:1.0:1788930001.375912:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2361:x1875828747110016:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930001.375922:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+31:2361:x1875828747110144:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 96us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930001.375933:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 163 00000100:00100000:3.0:1788930001.375951:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 164 00000100:00100000:3.0:1788930001.375962:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2361:x1875828747110400:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930001.375962:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2361:x1875828747110016:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 47us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930001.375977:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 298 00000100:00100000:3.0:1788930001.375999:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2361:x1875828747110400:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 40us (640us total) trans 0 rc 0/0 00000100:00080000:0.0:1788930001.376300:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930001.376541:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 164 00000100:00100000:0.0:1788930001.379000:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930001.379155:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747110272 00000100:00100000:1.0:1788930001.379166:0:12006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747110272 00000100:00100000:1.0:1788930001.379273:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 94 00000100:00100000:1.0:1788930001.379284:0:12006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2361:x1875828747110272:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930001.379369:0:12006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2361:x1875828747110272:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 87us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930001.379376:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 94 00000100:00080000:0.0:1788930001.379462:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788930002.332657:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788930002.977425:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788930002.977454:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2e890770c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788930002.977460:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2e98269800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2e89077d80 00000020:00080000:1.0:1788930002.977464:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2e98269900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2e81325400 00000020:00080000:1.0:1788930002.977491:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788930002.977496:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788930002.977763:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788930003.355570:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788930003.522181:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788930003.522496:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:1.0:1788930003.931401:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770161536:0@lo:400:kworker.0 00000100:00100000:3.0:1788930003.931447:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770161792:0@lo:400:kworker.0 00000100:00100000:2.0:1788930003.931678:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770161920:0@lo:400:kworker.0 00000100:00100000:1.0:1788930003.931871:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930003.931882:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930003.931937:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788930003.931939:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770162048:0@lo:400:kworker.0 00000100:00100000:3.0:1788930003.931942:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770161664:0@lo:400:kworker.0 00000100:00100000:3.0:1788930003.931973:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770161792 00000100:00100000:1.0:1788930003.931988:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930003.931999:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770161792 00000100:00100000:1.0:1788930003.932030:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770161536 00000100:00100000:1.0:1788930003.932034:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770161536 00000100:00100000:3.0:1788930003.932048:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770162048 00000100:00100000:3.0:1788930003.932050:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770162048 00000100:00100000:1.0:1788930003.932059:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788930003.932068:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3311:x1875828770161536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930003.932070:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788930003.932075:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770161792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930003.932115:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770161792:12345-0@lo:400:kworker.0 Request processed in 38us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930003.932115:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3311:x1875828770161536:12345-0@lo:400:kworker.0 Request processed in 49us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930003.932123:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788930003.932123:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788930003.932139:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788930003.932145:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770162048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930003.932159:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930003.932176:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770162176:0@lo:400:kworker.0 00000100:00100000:3.0:1788930003.932183:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770162048:12345-0@lo:400:kworker.0 Request processed in 39us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930003.932189:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788930003.932198:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930003.932200:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770161664 00000100:00100000:3.0:1788930003.932202:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770161664 00000100:00100000:3.0:1788930003.932216:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788930003.932239:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770161664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930003.932250:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770161792:0@lo:400:kworker.0 00000100:00100000:1.0:1788930003.932282:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770162048:0@lo:400:kworker.0 00000100:00100000:3.0:1788930003.932283:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770161664:12345-0@lo:400:kworker.0 Request processed in 61us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930003.932289:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770161536:0@lo:400:kworker.0 00000100:00100000:3.0:1788930003.932296:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:3.0:1788930003.932313:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788930003.932320:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770161664:0@lo:400:kworker.0 00000100:00100000:2.0:1788930003.932673:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930003.932847:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770162176 00000100:00100000:1.0:1788930003.932853:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770162176 00000100:00100000:2.0:1788930003.932864:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770161920 00000100:00100000:2.0:1788930003.932868:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770161920 00000100:00080000:3.0:1788930003.932914:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788930003.932917:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788930003.932942:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788930003.932946:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788930003.932950:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770162176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930003.932952:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770161920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930003.932989:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770162176:12345-0@lo:400:kworker.0 Request processed in 40us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930003.932996:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788930003.933032:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788930003.933037:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788930003.933067:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2eb5a3ea00, transno 4294967310 00000100:00100000:1.0:1788930003.933079:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770162176:0@lo:400:kworker.0 00000100:00100000:2.0:1788930003.933129:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770161920:12345-0@lo:400:kworker.0 Request processed in 176us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930003.933144:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788930003.933321:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788930003.933327:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2d86aeb480, transno 4294967322 00000004:00080000:2.0:1788930003.933338:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788930003.933367:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770161920:0@lo:400:kworker.0 00010000:00010000:0.0:1788930004.379843:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930004.443530:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788930004.443603:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930004.443805:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770162304 00000100:00100000:2.0:1788930004.443814:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770162304 00000100:00100000:2.0:1788930004.443864:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788930004.443873:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770162304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788930004.443914:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788930004.444038:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770162304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930004.444046:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788930004.444092:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770162304:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788930005.405117:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930005.993371:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770162432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788930005.993456:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930005.993569:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770162432 00000100:00100000:3.0:1788930005.993580:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770162432 00000100:00100000:3.0:1788930005.993652:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788930005.993662:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770162432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788930005.993698:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788930005.993749:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770162432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930005.993764:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788930005.993812:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770162432:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788930005.993873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788930006.429364:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930006.495103:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930006.495134:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930006.495160:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930006.495183:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930006.495204:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930006.495274:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747110784 00000100:00100000:2.0:1788930006.495306:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747110784 00000100:00100000:2.0:1788930006.495385:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747110912 00000100:00100000:2.0:1788930006.495389:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747110912 00000100:00100000:2.0:1788930006.495418:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 97 00000100:00100000:2.0:1788930006.495429:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2362:x1875828747110784:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930006.495515:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2362:x1875828747110784:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 87us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930006.495524:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 97 00000100:00100000:2.0:1788930006.495541:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 98 00000100:00100000:2.0:1788930006.495549:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2361:x1875828747110912:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930006.495576:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2361:x1875828747110912:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930006.495582:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 98 00000100:00100000:2.0:1788930006.495604:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747111040 00000100:00100000:2.0:1788930006.495609:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747111040 00000100:00100000:2.0:1788930006.495642:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747110656 00000100:00100000:2.0:1788930006.495645:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747110656 00000100:00100000:2.0:1788930006.495668:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 168 00000100:00100000:2.0:1788930006.495675:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747111040:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930006.495708:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2362:x1875828747111040:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 33us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930006.495714:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 168 00000100:00100000:2.0:1788930006.495728:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 169 00000100:00100000:2.0:1788930006.495734:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:2361:x1875828747110656:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930006.495778:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:2361:x1875828747110656:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 44us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930006.495793:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 169 00000100:00080000:2.0:1788930006.495823:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788930006.495830:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788930006.495832:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788930006.497078:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747110528 00000100:00100000:0.0:1788930006.497087:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747110528 00000100:00100000:0.0:1788930006.497139:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 300 00000100:00100000:0.0:1788930006.497149:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747110528:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788930006.497203:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2362:x1875828747110528:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 56us (2107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930006.497210:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 300 00000100:00100000:2.0:1788930006.790327:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930006.792494:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747111168 00000100:00100000:3.0:1788930006.792512:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747111168 00000100:00100000:3.0:1788930006.792577:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 237 00000100:00100000:3.0:1788930006.792588:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9ae1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:11293:x1875828747111168:12345-192.168.204.40@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788930006.792697:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9ae1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:11293:x1875828747111168:12345-192.168.204.40@tcp:60:lhsmtool_posix.0 Request processed in 111us (2380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930006.792704:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 237 00000100:00100000:2.0:1788930006.802251:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930006.802302:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747111424 00000100:00100000:2.0:1788930006.802315:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747111424 00000100:00100000:2.0:1788930006.802381:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:2.0:1788930006.802398:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:11293:x1875828747111424:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788930006.802786:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:11293:x1875828747111424:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 394us (569us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788930006.802795:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 65 00010000:00010000:0.0:1788930007.452216:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788930008.113474:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1788930008.113508:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788930008.113562:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788930008.113651:0:5872:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788930008.484099:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930009.054821:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770162944:0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.054907:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930009.054960:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788930009.054967:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770162560:0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.055007:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930009.055038:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770163072:0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.055064:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930009.055088:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770162688:0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.055109:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930009.055126:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770163200:0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.055145:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930009.055161:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788930009.055166:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770162816:0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.055184:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930009.055217:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770162944 00000100:00100000:0.0:1788930009.055242:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770162944 00000100:00100000:0.0:1788930009.055294:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770163200 00000100:00100000:0.0:1788930009.055297:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770163200 00000100:00100000:0.0:1788930009.055320:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788930009.055328:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770162944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.055619:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770162944:12345-0@lo:400:kworker.0 Request processed in 290us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930009.055626:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788930009.055644:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788930009.055651:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770163200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.055684:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770163200:12345-0@lo:400:kworker.0 Request processed in 34us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930009.055690:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788930009.055719:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770162560 00000100:00100000:0.0:1788930009.055723:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770162560 00000100:00100000:0.0:1788930009.055752:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788930009.055758:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3310:x1875828770162560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.055797:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3310:x1875828770162560:12345-0@lo:400:kworker.0 Request processed in 39us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930009.055803:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788930009.055828:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770163072 00000100:00100000:0.0:1788930009.055832:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770163072 00000100:00100000:0.0:1788930009.055854:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770162688 00000100:00100000:0.0:1788930009.055857:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770162688 00000100:00100000:0.0:1788930009.055867:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770162816 00000100:00100000:0.0:1788930009.055869:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770162816 00000100:00100000:0.0:1788930009.055882:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788930009.055887:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770163072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.055915:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770163072:12345-0@lo:400:kworker.0 Request processed in 28us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930009.055920:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788930009.055930:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788930009.055935:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770162688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.055959:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770162688:12345-0@lo:400:kworker.0 Request processed in 24us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930009.055965:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788930009.055975:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788930009.059265:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770162816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.059785:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770162816:12345-0@lo:400:kworker.0 Request processed in 542us (4597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930009.059794:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1788930009.059858:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788930009.059865:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788930009.059868:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788930009.059937:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770162816:0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.059951:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770162688:0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.059961:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770163200:0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.061124:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770162560:0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.061142:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770163072:0@lo:400:kworker.0 00000100:00100000:0.0:1788930009.061154:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770162944:0@lo:400:kworker.0 00000001:02000400:0.0:1788930009.112149:0:12808:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:00:06 (1788930006) 00010000:00010000:0.0:1788930009.499740:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930009.570642:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770163328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788930009.570726:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930009.570926:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770163328 00000100:00100000:0.0:1788930009.570936:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770163328 00000100:00100000:0.0:1788930009.570988:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788930009.570997:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb61cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770163328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788930009.571033:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788930009.571087:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb61cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770163328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930009.571094:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788930009.571191:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770163328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788930010.523426:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930011.100757:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788930011.100797:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770163456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788930011.100874:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930011.100939:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770163456 00000100:00100000:3.0:1788930011.100953:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770163456 00000100:00100000:3.0:1788930011.101015:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788930011.101029:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770163456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788930011.101070:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788930011.101115:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770163456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930011.101123:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788930011.101179:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770163456:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788930011.101389:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788930011.419549:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788930011.419558:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788930011.420070:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788930011.420078:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788930011.547340:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930011.611306:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930011.611345:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930011.611376:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930011.611399:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930011.611428:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930011.611455:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747111552 00000100:00100000:2.0:1788930011.611465:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747111552 00000100:00100000:2.0:1788930011.611511:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 302 00000100:00100000:2.0:1788930011.611520:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747111552:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930011.611592:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2360:x1875828747111552:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 72us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930011.611610:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 302 00000100:00100000:2.0:1788930011.611644:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747111936 00000100:00100000:2.0:1788930011.611647:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747111936 00000100:00100000:2.0:1788930011.611696:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747111808 00000100:00100000:2.0:1788930011.611699:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747111808 00000100:00100000:2.0:1788930011.612848:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 101 00000100:00100000:2.0:1788930011.612865:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb536a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2360:x1875828747111936:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930011.612919:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb536a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2360:x1875828747111936:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 59us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930011.613012:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747111680 00000100:00100000:3.0:1788930011.613018:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747111680 00000100:00100000:3.0:1788930011.613055:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747112064 00000100:00100000:3.0:1788930011.613058:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747112064 00000100:00100000:3.0:1788930011.613082:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 173 00000100:00100000:3.0:1788930011.613089:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebefdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:2360:x1875828747111680:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930011.613122:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebefdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:2360:x1875828747111680:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 34us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930011.613128:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 173 00000100:00100000:3.0:1788930011.613144:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 174 00000100:00100000:3.0:1788930011.613150:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747112064:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930011.613169:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2360:x1875828747112064:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 20us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930011.613174:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 174 00000100:00080000:3.0:1788930011.613368:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788930011.613373:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788930011.613375:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788930011.615296:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 102 00000100:00100000:1.0:1788930011.615316:0:12006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8870f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2360:x1875828747111808:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930011.615469:0:12006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8870f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2360:x1875828747111808:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 161us (4068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930011.615477:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 102 00000100:00100000:2.0:1788930011.615753:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 101 00000100:00100000:2.0:1788930012.158061:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930012.158161:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747112192 00000100:00100000:3.0:1788930012.158171:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747112192 00000100:00100000:3.0:1788930012.158265:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 238 00000100:00100000:3.0:1788930012.158275:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:12312:x1875828747112192:12345-192.168.204.40@tcp:101:lsof.0 00010000:00010000:3.0:1788930012.158298:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930012.158319:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c400/0xce4472dd2237d8c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021055c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930012.158377:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d8c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930012.158390:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930012.158403:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788930012.158437:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788930012.158440:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788930012.158493:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930012.158518:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c400/0xce4472dd2237d8c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021055c expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930012.158536:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d8c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021055c expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930012.158543:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038a00) 00010000:00010000:3.0:1788930012.158546:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788930012.158564:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8677dc00, rc 0) 00000100:00100000:3.0:1788930012.158682:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+6:12312:x1875828747112192:12345-192.168.204.40@tcp:101:lsof.0 Request processed in 407us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930012.158689:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 238 00010000:00010000:0.0:1788930012.574929:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930013.597059:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930014.171825:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770163968:0@lo:400:kworker.0 00000100:00100000:1.0:1788930014.171940:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930014.172009:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788930014.172015:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770163584:0@lo:400:kworker.0 00000100:00100000:1.0:1788930014.172041:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930014.172207:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770163968 00000100:00100000:3.0:1788930014.172218:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770163968 00000100:00100000:3.0:1788930014.172311:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788930014.172321:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770163968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930014.172378:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770163968:12345-0@lo:400:kworker.0 Request processed in 58us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930014.172385:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1788930014.172409:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788930014.172437:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770163840:0@lo:400:kworker.0 00000100:00100000:3.0:1788930014.172463:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930014.172482:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788930014.172488:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770163712:0@lo:400:kworker.0 00000100:00100000:3.0:1788930014.172837:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930014.172856:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770164224:0@lo:400:kworker.0 00000100:00100000:3.0:1788930014.172875:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930014.172903:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770163840 00000100:00100000:3.0:1788930014.172908:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770163840 00000100:00100000:3.0:1788930014.172949:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770163712 00000100:00100000:3.0:1788930014.172953:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770163712 00000100:00100000:3.0:1788930014.172970:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788930014.172977:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770163840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930014.173014:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770163840:12345-0@lo:400:kworker.0 Request processed in 37us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930014.173033:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788930014.173047:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788930014.173053:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770163712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930014.173092:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770163712:12345-0@lo:400:kworker.0 Request processed in 39us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930014.173098:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788930014.173118:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770164224 00000100:00100000:3.0:1788930014.173122:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770164224 00000100:00100000:3.0:1788930014.173149:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788930014.173156:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770164224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930014.173187:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770164224:12345-0@lo:400:kworker.0 Request processed in 32us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930014.173193:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1788930014.173211:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788930014.173215:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930014.173266:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770163712:0@lo:400:kworker.0 00000100:00100000:3.0:1788930014.173289:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770164224:0@lo:400:kworker.0 00000100:00100000:3.0:1788930014.173299:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770163840:0@lo:400:kworker.0 00000100:00100000:3.0:1788930014.173342:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770163584 00000100:00100000:3.0:1788930014.173346:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770163584 00000100:00100000:3.0:1788930014.173372:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788930014.173378:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3310:x1875828770163584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930014.173410:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3310:x1875828770163584:12345-0@lo:400:kworker.0 Request processed in 33us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930014.173428:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788930014.173758:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770164096:0@lo:400:kworker.0 00000100:00100000:1.0:1788930014.173789:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930014.173827:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770163968:0@lo:400:kworker.0 00000100:00100000:1.0:1788930014.173844:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770163584:0@lo:400:kworker.0 00000100:00100000:0.0:1788930014.174242:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770164096 00000100:00100000:0.0:1788930014.174249:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770164096 00000100:00100000:0.0:1788930014.174312:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788930014.174320:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770164096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930014.174363:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770164096:12345-0@lo:400:kworker.0 Request processed in 45us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930014.174381:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788930014.174521:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770164096:0@lo:400:kworker.0 00000100:00080000:2.0:1788930014.174632:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788930014.619455:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930014.683848:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788930014.683871:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770164352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788930014.683949:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930014.684379:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770164352 00000100:00100000:0.0:1788930014.684388:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770164352 00000100:00100000:0.0:1788930014.684443:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788930014.684452:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770164352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788930014.684487:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788930014.684543:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770164352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930014.684550:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788930014.684646:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770164352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788930014.911486:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930014.911575:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747112448 00000100:00100000:2.0:1788930014.911585:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747112448 00000100:00100000:2.0:1788930014.911674:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 66 00000100:00100000:2.0:1788930014.911685:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+18:12314:x1875828747112448:12345-192.168.204.40@tcp:35:umount.0 00000100:00100000:2.0:1788930014.912083:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:12314:x1875828747112448:12345-192.168.204.40@tcp:35:umount.0 Request processed in 398us (607us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788930014.912091:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 66 00000100:00080000:3.0:1788930014.912375:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788930014.923404:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930014.923499:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747112704 00000100:00100000:0.0:1788930014.923509:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747112704 00000100:00100000:0.0:1788930014.923566:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 67 00000100:00100000:0.0:1788930014.923576:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+19:12314:x1875828747112704:12345-192.168.204.40@tcp:35:umount.0 00000100:00100000:0.0:1788930014.923998:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:12314:x1875828747112704:12345-192.168.204.40@tcp:35:umount.0 Request processed in 423us (602us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788930014.924006:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 67 00000100:00100000:2.0:1788930014.927963:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930014.928148:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747112960 00000100:00100000:0.0:1788930014.928175:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747112960 00000100:00100000:2.0:1788930014.928376:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:2.0:1788930014.928403:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90953c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+20:12314:x1875828747112960:12345-192.168.204.40@tcp:35:umount.0 00000100:00100000:2.0:1788930014.928652:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90953c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:12314:x1875828747112960:12345-192.168.204.40@tcp:35:umount.0 Request processed in 251us (698us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788930014.928659:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 68 00000100:00100000:3.0:1788930014.931033:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930014.931200:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747113216 00000100:00100000:2.0:1788930014.931211:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747113216 00000100:00100000:2.0:1788930014.931306:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 69 00000100:00100000:2.0:1788930014.931317:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:12314:x1875828747113216:12345-192.168.204.40@tcp:35:umount.0 00000100:00100000:2.0:1788930014.931660:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:12314:x1875828747113216:12345-192.168.204.40@tcp:35:umount.0 Request processed in 344us (639us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788930014.931668:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 69 00000100:00100000:3.0:1788930014.961340:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930014.961383:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930014.961408:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930014.961580:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930014.961633:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747113728 00000100:00100000:3.0:1788930014.961642:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747113728 00000100:00100000:3.0:1788930014.961701:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 73 00000100:00100000:3.0:1788930014.961710:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2358:x1875828747113728:12345-192.168.204.40@tcp:9:umount.0 00000020:00000080:3.0:1788930014.961752:0:6989:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237cc27 00000100:00080000:3.0:1788930014.961761:0:6989:0:(import.c:65:import_set_state_nolock()) ffff8d2ebc971800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788930014.961802:0:6989:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788930014.962079:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:668b9f78-1e26-4a12-8f20-ad475b3553ba+2:2358:x1875828747113728:12345-192.168.204.40@tcp:9:umount.0 Request processed in 368us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930014.962087:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 73 00010000:00010000:3.0:1788930014.962108:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788930014.962115:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788930014.969539:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747113344 00000100:00100000:0.0:1788930014.969557:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747113344 00000100:00100000:0.0:1788930014.969636:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747113472 00000100:00100000:0.0:1788930014.969640:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747113472 00000100:00100000:0.0:1788930014.969652:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747113600 00000100:00100000:0.0:1788930014.969655:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747113600 00000100:00100000:0.0:1788930014.969674:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:0.0:1788930014.969684:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e881fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32bd5a92-c2e2-4642-929e-29df1e036b64+15:2361:x1875828747113344:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788930014.969699:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930014.969730:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237c8ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100ee expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930014.969748:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930014.969805:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e881fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32bd5a92-c2e2-4642-929e-29df1e036b64+14:2361:x1875828747113344:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 122us (8475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930014.969812:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:0.0:1788930014.969865:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:0.0:1788930014.969872:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32bd5a92-c2e2-4642-929e-29df1e036b64+13:2361:x1875828747113472:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788930014.969880:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930014.969889:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc596e00/0xce4472dd2237c8b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100b6 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930014.969898:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930014.969916:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32bd5a92-c2e2-4642-929e-29df1e036b64+12:2361:x1875828747113472:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 44us (8533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930014.969922:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:0.0:1788930014.969936:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:0.0:1788930014.969941:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32bd5a92-c2e2-4642-929e-29df1e036b64+11:2361:x1875828747113600:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788930014.969949:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930014.969957:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ea3c52800/0xce4472dd2237cb63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101b9 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930014.969969:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930014.969986:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2361:x1875828747113600:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 45us (8578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930014.969992:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:3.0:1788930014.974833:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930014.974926:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747114112 00000100:00100000:0.0:1788930014.974936:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747114112 00000100:00100000:0.0:1788930014.975019:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 74 00000100:00100000:0.0:1788930014.975029:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+7:2358:x1875828747114112:12345-192.168.204.40@tcp:9:umount.0 00000020:00000080:0.0:1788930014.975070:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237ce88 00000020:00010000:0.0:1788930014.975077:0:6688:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d2d84873000: total 0 00000100:00080000:0.0:1788930014.975082:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8d2e9adce000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788930014.975128:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788930014.975457:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+5:2358:x1875828747114112:12345-192.168.204.40@tcp:9:umount.0 Request processed in 429us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930014.975465:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 74 00000020:00010000:2.0:1788930014.975705:0:5828:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d2d84873000: total 0 00010000:00010000:2.0:1788930014.975733:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2d84873000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788930014.975786:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c81fb88e/0xce4472dd2237d8bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210555 expref: 4 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.975822:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000343707be/0xce4472dd2237d22b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021038e expref: 3 pid: 6989 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.975837:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2d84873000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788930014.975848:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930014.975850:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930014.975852:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788930014.976574:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788930014.994170:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930014.994426:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747115136 00000100:00100000:0.0:1788930014.994437:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747115136 00000100:00100000:0.0:1788930014.994499:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 239 00000100:00100000:0.0:1788930014.994510:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+22:2358:x1875828747115136:12345-192.168.204.40@tcp:39:umount.0 00000020:00000080:0.0:1788930014.994547:0:5841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c8c3 00000020:00010000:0.0:1788930014.994565:0:5841:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d2e881f7000: total 0 00000100:00080000:0.0:1788930014.994569:0:5841:0:(import.c:65:import_set_state_nolock()) ffff8d2e881f2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788930014.994611:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788930014.994998:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:668b9f78-1e26-4a12-8f20-ad475b3553ba+21:2358:x1875828747115136:12345-192.168.204.40@tcp:39:umount.0 Request processed in 489us (847us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788930014.995007:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 239 00000020:00010000:2.0:1788930014.995273:0:7628:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d2e881f7000: total 0 00010000:00010000:2.0:1788930014.995314:0:7628:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2e881f7000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788930014.995346:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788930014.995363:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788930014.995372:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677d200/0xce4472dd2237d79c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210508 expref: 20 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.995392:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:2.0:1788930014.995394:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788930014.995398:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2152200/0xce4472dd2237d29b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103aa expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.995411:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:2.0:1788930014.995413:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930014.995417:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237cba9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101ce expref: 18 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.995434:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:2.0:1788930014.995436:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788930014.995440:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237d1ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210379 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.995454:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2e83038e00) 00010000:00010000:2.0:1788930014.995456:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788930014.995460:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8a00/0xce4472dd2237cb8d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101c7 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.995474:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:2.0:1788930014.995476:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788930014.995479:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596000/0xce4472dd2237d216 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210387 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.995506:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2e98756700) 00010000:00010000:2.0:1788930014.995509:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788930014.995513:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597c00/0xce4472dd2237d10c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210341 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.995529:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788930014.995532:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788930014.995535:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ec2153c00/0xce4472dd2237d87c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210540 expref: 13 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.995548:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:2.0:1788930014.995550:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788930014.995553:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9a00/0xce4472dd2237cbfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101e3 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.995564:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038a00) 00010000:00010000:2.0:1788930014.995566:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788930014.995569:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237d27f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402103a3 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.995579:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2e83038600) 00010000:00010000:2.0:1788930014.995581:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788930014.995584:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237ceea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402102b5 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.995611:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2eb85fd600) 00010000:00010000:2.0:1788930014.995613:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788930014.995624:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677c800/0xce4472dd2237d57a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021047c expref: 9 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.995640:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788930014.995643:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788930014.995646:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237d8a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021054e expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930014.995658:0:7628:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2e881f7000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788930014.995671:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930014.995673:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930014.995675:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930015.643441:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930016.220418:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788930016.220439:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770164480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788930016.220511:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930016.220586:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770164480 00000100:00100000:0.0:1788930016.220594:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770164480 00000100:00100000:0.0:1788930016.220665:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788930016.220674:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770164480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788930016.220708:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788930016.220755:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770164480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930016.220762:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788930016.220809:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770164480:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788930016.220963:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788930016.360869:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 668b9f78-1e26-4a12-8f20-ad475b3553ba 00000020:00000080:3.0:1788930016.360880:0:7639:0:(genops.c:885:class_export_put()) final put ffff8d2ebc974000/668b9f78-1e26-4a12-8f20-ad475b3553ba 00000020:00000080:2.0:1788930016.360966:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebc974000/668b9f78-1e26-4a12-8f20-ad475b3553ba for lustre-OST0001 00000020:00000080:2.0:1788930016.361031:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2ebc971800 for lustre-OST0001 00010000:00010000:2.0:1788930016.669217:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930016.730519:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930016.730588:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930016.730687:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747115392 00000100:00100000:1.0:1788930016.730698:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747115392 00000100:00100000:1.0:1788930016.730778:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 178 00000100:00100000:1.0:1788930016.730788:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+6:2360:x1875828747115392:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930016.730863:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8abb2367-c028-4bae-a29f-54a7e42177aa+6:2360:x1875828747115392:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 76us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930016.730871:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 178 00000100:00080000:2.0:1788930016.730941:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930016.731344:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747115264 00000100:00100000:3.0:1788930016.731351:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747115264 00000100:00100000:3.0:1788930016.731392:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 304 00000100:00100000:3.0:1788930016.731400:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2360:x1875828747115264:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930016.731443:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32bd5a92-c2e2-4642-929e-29df1e036b64+10:2360:x1875828747115264:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 44us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930016.731450:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 304 00000100:00100000:3.0:1788930017.489756:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930017.489801:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930017.490119:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747115520 00000100:00100000:2.0:1788930017.490130:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747115520 00000100:00100000:2.0:1788930017.490201:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747115648 00000100:00100000:2.0:1788930017.490205:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747115648 00000100:00100000:2.0:1788930017.490276:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:2.0:1788930017.490286:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32bd5a92-c2e2-4642-929e-29df1e036b64+11:2360:x1875828747115520:12345-192.168.204.40@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788930017.490300:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 22 00010000:00010000:2.0:1788930017.490303:0:7629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788930017.490313:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32bd5a92-c2e2-4642-929e-29df1e036b64+11:2360:x1875828747115648:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788930017.490325:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e80031400/0xce4472dd2237c995 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210103 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930017.490337:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788930017.490346:0:7629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788930017.490353:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ea3c53200/0xce4472dd2237cb5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402101b2 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930017.490368:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788930017.490403:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32bd5a92-c2e2-4642-929e-29df1e036b64+9:2360:x1875828747115520:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 117us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930017.490406:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32bd5a92-c2e2-4642-929e-29df1e036b64+9:2360:x1875828747115648:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 96us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930017.490513:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00100000:2.0:1788930017.494493:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:3.0:1788930017.494529:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930017.494791:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747115776 00000100:00100000:0.0:1788930017.494800:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747115776 00000100:00100000:0.0:1788930017.494860:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:0.0:1788930017.494870:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32bd5a92-c2e2-4642-929e-29df1e036b64+8:2362:x1875828747115776:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788930017.494885:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930017.494904:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e80031200/0xce4472dd2237c99c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021012d expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930017.494923:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930017.494988:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32bd5a92-c2e2-4642-929e-29df1e036b64+7:2362:x1875828747115776:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 120us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930017.494995:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:0.0:1788930017.509631:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930017.509885:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747116032 00000100:00100000:3.0:1788930017.509896:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747116032 00000100:00100000:3.0:1788930017.509972:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 240 00000100:00100000:3.0:1788930017.509983:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+6:2358:x1875828747116032:12345-192.168.204.40@tcp:39:umount.0 00000020:00000080:3.0:1788930017.510037:0:5841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c9aa 00000020:00010000:3.0:1788930017.510047:0:5841:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d2d8482f800: total 0 00000100:00080000:3.0:1788930017.510068:0:5841:0:(import.c:65:import_set_state_nolock()) ffff8d2d8482d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788930017.510101:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788930017.510385:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8abb2367-c028-4bae-a29f-54a7e42177aa+5:2358:x1875828747116032:12345-192.168.204.40@tcp:39:umount.0 Request processed in 403us (763us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788930017.510394:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 240 00000020:00010000:2.0:1788930017.510491:0:7628:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d2d8482f800: total 0 00010000:00010000:2.0:1788930017.510496:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930017.510535:0:7628:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2d8482f800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788930017.510583:0:7628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038a00) 00010000:00010000:2.0:1788930017.510587:0:7628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788930017.510594:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8677dc00/0xce4472dd2237d8c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021055c expref: 4 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930017.510615:0:7628:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2d8482f800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788930017.510625:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930017.510627:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930017.510629:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930017.538610:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930017.538691:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747116288 00000100:00100000:3.0:1788930017.538701:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747116288 00000100:00100000:3.0:1788930017.538761:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 305 00000100:00100000:3.0:1788930017.538772:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+7:2358:x1875828747116288:12345-192.168.204.40@tcp:251:umount.0 00000020:00000080:3.0:1788930017.538819:0:5833:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c8a0 00000020:00010000:3.0:1788930017.538828:0:5833:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d2e87c52800: total 0 00000100:00080000:3.0:1788930017.538832:0:5833:0:(import.c:65:import_set_state_nolock()) ffff8d2e87c50800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788930017.538913:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32bd5a92-c2e2-4642-929e-29df1e036b64+3:2358:x1875828747116288:12345-192.168.204.40@tcp:251:umount.0 Request processed in 143us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930017.538920:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 305 00000020:00010000:1.0:1788930017.539211:0:5827:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d2e87c52800: total 0 00010000:00010000:1.0:1788930017.539294:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2e87c52800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788930017.539328:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e80030800/0xce4472dd2237c8f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402100f5 expref: 2 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930017.539342:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2e87c52800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788930017.539366:0:5827:0:(genops.c:885:class_export_put()) final put ffff8d2e87c52800/32bd5a92-c2e2-4642-929e-29df1e036b64 00010000:00010000:1.0:1788930017.539379:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930017.539381:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930017.539384:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788930017.539512:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e87c52800/32bd5a92-c2e2-4642-929e-29df1e036b64 for MGS 00000020:00000080:3.0:1788930017.539554:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e87c50800 for MGS 00010000:00010000:2.0:1788930017.691503:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788930018.359422:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 668b9f78-1e26-4a12-8f20-ad475b3553ba 00000001:00080000:1.0:1788930018.359448:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1788930018.359466:0:5861:0:(genops.c:885:class_export_put()) final put ffff8d2e881f7000/668b9f78-1e26-4a12-8f20-ad475b3553ba 00000001:00100000:1.0:1788930018.359503:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8abb2367-c028-4bae-a29f-54a7e42177aa 00000001:00080000:1.0:1788930018.359509:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788930018.359511:0:5861:0:(genops.c:885:class_export_put()) final put ffff8d2d8482f800/8abb2367-c028-4bae-a29f-54a7e42177aa 00000020:00000080:0.0:1788930018.361076:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e881f7000/668b9f78-1e26-4a12-8f20-ad475b3553ba for lustre-MDT0000 00000020:00000080:0.0:1788930018.361166:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d8482f800/8abb2367-c028-4bae-a29f-54a7e42177aa for lustre-MDT0000 00000020:00000080:0.0:1788930018.361192:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e881f2800 for lustre-MDT0000 00000020:00000080:0.0:1788930018.361199:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d8482d000 for lustre-MDT0000 00010000:00010000:2.0:1788930018.715414:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788930018.946526:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 668b9f78-1e26-4a12-8f20-ad475b3553ba 00000020:00000080:1.0:1788930018.946535:0:6716:0:(genops.c:885:class_export_put()) final put ffff8d2d84873000/668b9f78-1e26-4a12-8f20-ad475b3553ba 00000020:00000080:1.0:1788930018.946573:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84873000/668b9f78-1e26-4a12-8f20-ad475b3553ba for lustre-OST0000 00000020:00000080:1.0:1788930018.946631:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e9adce000 for lustre-OST0000 00000100:00100000:0.0:1788930019.300064:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770164608:0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.300145:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930019.300216:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770164608 00000100:00100000:0.0:1788930019.300252:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770164608 00000100:00100000:0.0:1788930019.300305:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788930019.300314:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e865b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3311:x1875828770164608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.300382:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e865b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3311:x1875828770164608:12345-0@lo:400:kworker.0 Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930019.300390:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788930019.300438:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770164608:0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.300481:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770164736:0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.300519:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930019.300557:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770164736 00000100:00100000:0.0:1788930019.300560:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770164736 00000100:00100000:0.0:1788930019.300588:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788930019.300595:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770164736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.300631:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770164736:12345-0@lo:400:kworker.0 Request processed in 37us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930019.300637:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788930019.300665:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770164736:0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.300695:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770164864:0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.300719:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930019.300745:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770164864 00000100:00100000:0.0:1788930019.300749:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770164864 00000100:00100000:0.0:1788930019.300781:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788930019.300801:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770164864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.300835:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770164864:12345-0@lo:400:kworker.0 Request processed in 36us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930019.300841:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1788930019.300858:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788930019.300879:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770164864:0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.300913:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770164992:0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.300940:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930019.300969:0:12006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770164992 00000100:00100000:0.0:1788930019.300973:0:12006:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770164992 00000100:00100000:0.0:1788930019.301004:0:12006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788930019.301011:0:12006:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770164992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.301043:0:12006:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770164992:12345-0@lo:400:kworker.0 Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930019.301049:0:12006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1788930019.301067:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788930019.301083:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770164992:0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.301116:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770165120:0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.301139:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930019.301162:0:11024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770165120 00000100:00100000:0.0:1788930019.301166:0:11024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770165120 00000100:00100000:0.0:1788930019.301191:0:11024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788930019.301198:0:11024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770165120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.301257:0:11024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770165120:12345-0@lo:400:kworker.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930019.301274:0:11024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:0.0:1788930019.301290:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788930019.301306:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770165120:0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.301339:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770165248:0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.301360:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930019.301385:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770165248 00000100:00100000:0.0:1788930019.301388:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770165248 00000100:00100000:0.0:1788930019.301412:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788930019.301417:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770165248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930019.301448:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770165248:12345-0@lo:400:kworker.0 Request processed in 30us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930019.301453:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1788930019.301470:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788930019.301486:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770165248:0@lo:400:kworker.0 00010000:00010000:1.0:1788930019.740472:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930019.813555:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770165376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788930019.813651:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930019.815537:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770165376 00000100:00100000:0.0:1788930019.815552:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770165376 00000100:00100000:0.0:1788930019.815626:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788930019.815638:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770165376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788930019.815682:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788930019.823919:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770165376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8274us (10258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930019.823934:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788930019.826699:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770165376:0@lo:13:osp-pre-1-0.0 00000020:01000004:2.0:1788930020.634433:0:13012:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788930020.661254:0:13012:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788930020.661319:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.661338:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.661346:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.661372:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.661394:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788930020.661400:0:13012:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788930020.661435:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930020.661443:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.661451:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784c00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:2.0:1788930020.661455:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.661466:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788930020.661478:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930020.661494:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788930020.661497:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788930020.661500:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788930020.661546:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.661552:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788930020.674960:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.674983:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237c933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c93a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.675033:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930020.675035:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930020.675038:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930020.675059:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788930020.675089:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770165504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788930020.675191:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930020.675288:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770165504 00000100:00100000:2.0:1788930020.675299:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770165504 00000100:00100000:2.0:1788930020.675371:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788930020.675381:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3311:x1875828770165504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788930020.675397:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788930020.675417:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e80030c00/0xce4472dd2237c93a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237c933 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.675433:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788930020.675487:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:3311:x1875828770165504:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930020.675495:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788930020.675533:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788930020.675538:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788930020.675545:0:13012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788930020.675582:0:13012:0:(import.c:65:import_set_state_nolock()) ffff8d2e85c16800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788930020.675610:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770165632:0@lo:39:umount.0 00000100:00100000:2.0:1788930020.675659:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930020.675697:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770165632 00000100:00100000:2.0:1788930020.675701:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770165632 00000100:00100000:2.0:1788930020.675739:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788930020.675746:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875828770165632:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788930020.675784:0:5841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c6af 00000100:00080000:2.0:1788930020.675792:0:5841:0:(import.c:65:import_set_state_nolock()) ffff8d2e91360000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788930020.675846:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3307:x1875828770165632:12345-0@lo:39:umount.0 Request processed in 100us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930020.675852:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:2.0:1788930020.675858:0:5841:0:(genops.c:885:class_export_put()) final put ffff8d2e91367000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788930020.675884:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788930020.675894:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e91367000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788930020.675942:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e91360000 for lustre-MDT0000 00000100:00080000:2.0:1788930020.675975:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e85c16800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788930020.675981:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770165632:0@lo:39:umount.0 00000100:00080000:2.0:1788930020.676001:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788930020.676003:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788930020.676007:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788930020.676186:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770165504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788930020.676872:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.676885:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.676892:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.676899:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.676914:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930020.676932:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.676940:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.676946:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.676952:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.676967:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788930020.676980:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788930020.676986:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.676993:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340e00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:2.0:1788930020.676997:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677006:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788930020.677014:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930020.677020:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788930020.677023:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788930020.677053:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677071:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788930020.677099:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677107:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237c941 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c948 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930020.677117:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770165760:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788930020.677122:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930020.677127:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677133:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ea3c53400 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:2.0:1788930020.677136:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677143:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788930020.677150:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930020.677155:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788930020.677158:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788930020.677160:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:3.0:1788930020.677173:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788930020.677178:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677185:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788930020.677203:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677220:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ea3c53400/0xce4472dd2237c85a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c861 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677256:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930020.677258:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930020.677259:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930020.677267:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788930020.677276:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770165888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788930020.677306:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788930020.677338:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677347:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677352:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677358:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677370:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930020.677378:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930020.677383:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677389:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596a00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:2.0:1788930020.677391:0:7628:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677403:0:7628:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788930020.677409:0:7628:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930020.677416:0:7628:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788930020.677418:0:7628:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788930020.677421:0:7628:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788930020.677454:0:7628:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677461:0:7628:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788930020.677471:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677477:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596a00/0xce4472dd2237cb4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237cb55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677500:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930020.677501:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930020.677503:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930020.677512:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770166016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788930020.677535:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930020.677560:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770165760 00000100:00100000:2.0:1788930020.677565:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770165760 00000100:00100000:2.0:1788930020.677598:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770165888 00000100:00100000:2.0:1788930020.677601:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770165888 00000100:00100000:2.0:1788930020.677613:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770166016 00000100:00100000:2.0:1788930020.677615:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770166016 00000100:00100000:2.0:1788930020.677639:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788930020.677647:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e881fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+20:3311:x1875828770165760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788930020.677658:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788930020.677671:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e99784000/0xce4472dd2237c948 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237c941 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.677684:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788930020.678564:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e881fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+19:3311:x1875828770165760:12345-0@lo:103:ldlm_bl.0 Request processed in 912us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930020.678588:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788930020.678645:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788930020.678654:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+18:3309:x1875828770165888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788930020.678665:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788930020.678679:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237c861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237c85a expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.678696:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788930020.678735:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+17:3309:x1875828770165888:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930020.678741:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788930020.678757:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788930020.678763:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+16:3309:x1875828770166016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788930020.678786:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788930020.678796:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc597000/0xce4472dd2237cb55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237cb4e expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.678805:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788930020.678842:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:3309:x1875828770166016:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930020.678848:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788930020.678892:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770166016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788930020.678901:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bddba76f-ee04-4b28-985b-cc9b0811bff7:3309:1875828770165888:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788930020.678941:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80030600/0xce4472dd2237c60e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.678951:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80030600/0xce4472dd2237c60e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.678958:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80030600/0xce4472dd2237c60e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.678964:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2e80030600/0xce4472dd2237c60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.678979:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788930020.678984:0:13012:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788930020.678988:0:13012:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788930020.679016:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930020.679022:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e80030600/0xce4472dd2237c60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.679028:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e80030600 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:2.0:1788930020.679031:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e80030600/0xce4472dd2237c60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.679038:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e80030600/0xce4472dd2237c60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788930020.679052:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e80030600/0xce4472dd2237c60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930020.679058:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788930020.679061:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788930020.679063:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788930020.679081:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e80030600/0xce4472dd2237c60e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.679087:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788930020.679100:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e80030600/0xce4472dd2237c60e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.679105:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e80030600/0xce4472dd2237c60e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c615 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.679117:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930020.679118:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930020.679120:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788930020.679132:0:13012:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788930020.679136:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788930020.679140:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788930020.679147:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788930020.679152:0:13012:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d2eb5b84000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788930020.679157:0:13012:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d2d84877000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788930020.679163:0:13012:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8d2e87cacd40) has exports, disconnecting them 00000020:00080000:2.0:1788930020.679168:0:13012:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d2eb5b84000), last request at 1788930019 00000020:00000080:2.0:1788930020.679174:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c822 00000100:00100000:0.0:1788930020.680723:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770166144:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788930020.682643:0:13012:0:(import.c:65:import_set_state_nolock()) ffff8d2eb5b82800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788930020.682740:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788930020.682760:0:13012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2eb5b84000): rc 0 00000020:00000080:2.0:1788930020.682898:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2eb5b84000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788930020.682919:0:13012:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d2d84877000), last request at 1788930019 00000020:00000080:2.0:1788930020.682927:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c749 00000100:00080000:2.0:1788930020.682939:0:13012:0:(import.c:65:import_set_state_nolock()) ffff8d2d84874000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788930020.682954:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788930020.682963:0:13012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2d84877000): rc 0 00000020:00000080:2.0:1788930020.682965:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2d84877000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788930020.682978:0:13012:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa545c1d2fae0 00000100:00080000:2.0:1788930020.682998:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788930020.683002:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788930020.683019:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788930020.683092:0:13012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788930020.683124:0:13012:0:(import.c:65:import_set_state_nolock()) ffff8d2d85ebe800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788930020.683143:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788930020.683146:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788930020.683155:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788930020.683247:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770166272:0@lo:9:umount.0 00000100:00100000:2.0:1788930020.683686:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930020.684088:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770166272 00000100:00100000:2.0:1788930020.684101:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770166272 00000100:00100000:2.0:1788930020.684169:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788930020.684180:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875828770166272:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788930020.684214:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c7b2 00000100:00080000:2.0:1788930020.684254:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d2d84872800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788930020.684299:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788930020.686010:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3307:x1875828770166272:12345-0@lo:9:umount.0 Request processed in 1822us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930020.686051:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1788930020.686101:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788930020.686144:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2d85ebe800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788930020.686158:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788930020.686161:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788930020.686165:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770166272:0@lo:9:umount.0 00000100:00080000:2.0:1788930020.686210:0:13012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788930020.686251:0:13012:0:(import.c:65:import_set_state_nolock()) ffff8d2e87c55000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788930020.686276:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770166400:0@lo:9:umount.0 00000100:00100000:2.0:1788930020.686312:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930020.686351:0:6989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770166400 00000100:00100000:2.0:1788930020.686358:0:6989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770166400 00000100:00100000:2.0:1788930020.686397:0:6989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788930020.686406:0:6989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875828770166400:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788930020.686433:0:6989:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c88b 00000100:00080000:2.0:1788930020.686442:0:6989:0:(import.c:65:import_set_state_nolock()) ffff8d2e87c53000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788930020.686470:0:6989:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1788930020.688630:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788930020.691140:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5b84000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788930020.694798:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84877000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1788930020.695469:0:6989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3307:x1875828770166400:12345-0@lo:9:umount.0 Request processed in 9057us (9149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930020.695495:0:6989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:2.0:1788930020.695528:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788930020.695584:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e87c55000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788930020.695597:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788930020.695599:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788930020.695604:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770166400:0@lo:9:umount.0 00000020:00080000:2.0:1788930020.695671:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d2e87cacd40) has no exports 00000020:00000080:3.0:1788930020.701785:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2eb5b82800 for lustre-MDT0000 00000020:00000080:3.0:1788930020.701799:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d84874000 for lustre-MDT0000 00000100:00100000:3.0:1788930020.701893:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bddba76f-ee04-4b28-985b-cc9b0811bff7:3311:1875828770165760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788930020.702355:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930020.702730:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770166144 00000100:00100000:2.0:1788930020.702757:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770166144 00000100:00100000:2.0:1788930020.702837:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788930020.702847:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84378380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+15:3310:x1875828770166144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788930020.702863:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788930020.702881:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e99785000/0xce4472dd2237c615 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237c60e expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930020.702900:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788930020.702961:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84378380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bddba76f-ee04-4b28-985b-cc9b0811bff7+14:3310:x1875828770166144:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930020.702969:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788930020.703270:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770166144:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788930020.728668:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d2e87cacd40) has no exports 00010000:00010000:2.0:1788930020.763997:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788930020.789747:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c669 00000020:00000080:0.0:1788930020.789764:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2e90369000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788930020.789791:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788930020.789857:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e90369000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788930020.789886:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788930020.789897:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788930020.789901:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8d2eb7288000) has no exports 00000020:00000080:2.0:1788930020.790472:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c662 00000020:00000080:2.0:1788930020.790490:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2eb7281800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788930020.790773:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb7281800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788930020.791149:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788930020.791167:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788930020.791171:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2eb7283000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788930020.791174:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb7283000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788930020.791179:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788930020.791737:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2e91653660 - data ffff8d2e90ed1798/ffff8d2ebcb36c00 00000020:01000000:2.0:1788930020.791877:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2e90197d20 - data ffff8d2eacb3cbd0/ffff8d2eb7129400 00000001:00000004:2.0:1788930020.848593:0:13012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1788930021.031518:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788930021.031528:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788930021.031557:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788930021.031559:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788930021.033937:0:6713:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788930021.033962:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788930021.033978:0:6713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788930021.035487:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788930021.035496:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788930021.035515:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788930021.035518:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788930021.037196:0:7928:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788930021.037204:0:7928:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788930021.037217:0:7928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788930021.112277:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c631 00000020:00000080:0.0:1788930021.112293:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2eb5352800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788930021.113611:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c646 00000020:00000080:0.0:1788930021.113620:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2eb61d0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788930021.113627:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788930021.113634:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788930021.113642:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788930021.113647:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8d2e87cab380) has no exports 00000004:01000000:0.0:1788930021.113798:0:13012:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788930021.113807:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c884 00000020:00000080:0.0:1788930021.113811:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2e87c57800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788930021.113815:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788930021.113818:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788930021.113825:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788930021.113827:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8d2e881e0000) has no exports 00000020:00000080:0.0:1788930021.113833:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c87d 00000020:00000080:0.0:1788930021.113837:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2e87c56000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788930021.114155:0:13012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788930021.114160:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788930021.114164:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788930021.114169:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788930021.114182:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788930021.114208:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788930021.114215:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788930021.114245:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c78f 00000020:00000080:0.0:1788930021.114249:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2ebefd7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788930021.114254:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788930021.114257:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788930021.114261:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788930021.114264:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8d2e863799c0) has no exports 00000020:00000080:0.0:1788930021.114268:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c788 00000020:00000080:0.0:1788930021.114270:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2d85ebc800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788930021.114614:0:13012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788930021.114617:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788930021.114620:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788930021.114623:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788930021.114624:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788930021.114653:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788930021.114658:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788930021.114681:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788930021.114684:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788930021.114709:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c64d 00000020:00000080:0.0:1788930021.114715:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2eb61d5000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788930021.114718:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788930021.114722:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788930021.114725:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788930021.114727:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8d2e87ca99c0) has no exports 00000020:00000080:0.0:1788930021.114745:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788930021.114748:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788930021.114752:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c654 00000020:00000080:0.0:1788930021.114755:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2eb61d6000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788930021.114761:0:13012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2e86b99000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788930021.114765:0:13012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2e86b99000 3 00000020:01000004:0.0:1788930021.114767:0:13012:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2e86b99000 from lustre-MDT0000 00000020:00000080:0.0:1788930021.114791:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788930021.114795:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788930021.114798:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2eb5354000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788930021.114801:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5354000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788930021.114808:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788930021.114873:0:13012:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788930021.114877:0:13012:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788930021.114880:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788930021.114883:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788930021.114886:0:13012:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788930021.114892:0:13012:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8d2e84db1000 bddba76f-ee04-4b28-985b-cc9b0811bff7 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788930021.114898:0:13012:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8d2e9162cd40) has exports, disconnecting them 00000020:00080000:0.0:1788930021.114902:0:13012:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d2e84db1000), last request at 1788929787 00000020:00000080:0.0:1788930021.114916:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c5f2 00000020:00010000:0.0:1788930021.114921:0:13012:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d2e84db1000: total 8 00000100:00080000:0.0:1788930021.114925:0:13012:0:(import.c:65:import_set_state_nolock()) ffff8d2e84db2000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788930021.115020:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5352800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788930021.115034:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb61d0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788930021.115037:0:37:0:(genops.c:885:class_export_put()) final put ffff8d2eb5350000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788930021.115039:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5350000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788930021.115042:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788930021.115142:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e87c57800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788930021.115147:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e87c56000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788930021.115159:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e87c55000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788930021.115164:0:37:0:(genops.c:885:class_export_put()) final put ffff8d2e87c54000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788930021.115166:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e87c54000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788930021.115169:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788930021.115197:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebefd7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788930021.115202:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d85ebc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788930021.115205:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d85ebe800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788930021.115209:0:37:0:(genops.c:885:class_export_put()) final put ffff8d2ebefd0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788930021.115210:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebefd0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788930021.115213:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788930021.115293:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb61d5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788930021.115296:0:37:0:(genops.c:885:class_export_put()) final put ffff8d2eb5355800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788930021.115298:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5355800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788930021.115301:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788930021.115452:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb61d6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:0.0:1788930021.123037:0:13012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2e84db1000): rc 0 00000020:00080000:0.0:1788930021.123048:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8d2e9162cd40) has no exports 00000020:00010000:3.0:1788930021.123619:0:5827:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d2e84db1000: total 0 00010000:00010000:3.0:1788930021.123682:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2e84db1000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788930021.123717:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc596200/0xce4472dd2237cb47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237cb40 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930021.123742:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2153a00/0xce4472dd2237c6fc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237c6f5 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930021.123762:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e80030200/0xce4472dd2237c956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237c94f expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930021.123774:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc597200/0xce4472dd2237c910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237c909 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930021.123783:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e99785200/0xce4472dd2237c902 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237c8fb expref: 5 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930021.123795:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ea3c53800/0xce4472dd2237cb39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237cb32 expref: 4 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930021.123809:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5340c00/0xce4472dd2237c91e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237c917 expref: 3 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930021.123818:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e99785800/0xce4472dd2237c92c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237c925 expref: 2 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930021.123828:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2e84db1000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788930021.123840:0:5827:0:(genops.c:885:class_export_put()) final put ffff8d2e84db1000/bddba76f-ee04-4b28-985b-cc9b0811bff7 00010000:00010000:3.0:1788930021.123857:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930021.123872:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930021.123874:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930021.125195:0:5834:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d2e86561e00:5834] 2 exiting: rc = 0 00000020:00000080:1.0:1788930021.125297:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e84db1000/bddba76f-ee04-4b28-985b-cc9b0811bff7 for MGS 00000020:00000080:1.0:1788930021.125332:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e84db2000 for MGS 00000100:00100000:0.0:1788930021.130846:0:5831:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d2e86561200:5831] 0 exiting: rc = 1 00000100:00100000:3.0:1788930021.135132:0:5833:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d2e86561800:5833] 1 exiting: rc = 0 00000100:00100000:3.0:1788930021.135300:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135309:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135314:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135322:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135329:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135335:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135340:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135345:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135352:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135359:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135365:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135371:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135377:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135383:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135388:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135395:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135401:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135407:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135413:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135419:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135425:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135436:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135441:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135447:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135454:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135459:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135464:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135482:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135489:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135496:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135502:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135508:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135531:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135537:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135543:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135549:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135555:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135561:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135581:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135588:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135593:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135599:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135604:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135611:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135617:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135623:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135628:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135634:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135640:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135646:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135652:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135657:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135663:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135668:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135674:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135681:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135686:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135692:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135698:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135705:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135710:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135716:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135722:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930021.135728:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788930021.137851:0:13012:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788930021.137858:0:13012:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788930021.146168:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2eb5a25ae0 - data ffff8d2eb8c5a1b0/ffff8d2ebcc4ac00 00000020:01000000:3.0:1788930021.146333:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2e83d3f300 - data ffff8d2eacbce360/ffff8d2e8502cc00 00000020:00000080:3.0:1788930021.146964:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c5d6 00000020:00000080:3.0:1788930021.146971:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2e86b9a800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788930021.147027:0:13012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2e86b99000 from MGS, refs=2 00000020:01000004:3.0:1788930021.147031:0:13012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2e86b99000 2 00000020:01000004:3.0:1788930021.147035:0:13012:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2e86b99000 from MGS 00000020:00000080:3.0:1788930021.147059:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788930021.147065:0:13012:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788930021.147068:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2e86b98000/MGS 00000020:00000080:3.0:1788930021.147070:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e86b98000/MGS for MGS 00000020:01000000:3.0:1788930021.147077:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788930021.147135:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788930021.147139:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788930021.147144:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788930021.147151:0:13012:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d2e91359000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788930021.147156:0:13012:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8d2e8637cd40) has exports, disconnecting them 00000020:00080000:3.0:1788930021.147161:0:13012:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d2e91359000), last request at 1788929788 00000020:00000080:3.0:1788930021.147165:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c6a1 00000020:00080000:3.0:1788930021.147170:0:13012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2e91359000): rc 0 00000020:00000080:3.0:1788930021.147175:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2e91359000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788930021.150762:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e86b9a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788930021.151744:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e91359000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788930021.152031:0:13012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788930021.152037:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788930021.152041:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788930021.152047:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788930021.152201:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788930021.152210:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788930021.152218:0:13012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2e86b99000 1 00000020:00000080:3.0:1788930021.152286:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c5c8 00000020:00000080:3.0:1788930021.152297:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2e86b99800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788930021.152301:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788930021.152309:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788930021.152326:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788930021.152331:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8d2e9162b380) has no exports 00000020:00000080:1.0:1788930021.152502:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e85c16800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788930021.152512:0:8:0:(genops.c:885:class_export_put()) final put ffff8d2e9135d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788930021.152515:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e9135d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788930021.152519:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788930021.152580:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e86b99800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788930021.203574:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788930021.203589:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788930021.203595:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2e86b9b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788930021.203599:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e86b9b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788930021.203610:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788930021.203762:0:13012:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d2e86b9e000 00000020:01000000:0.0:1788930021.203785:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788930021.203789:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788930021.203793:0:13012:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788930021.203797:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8d2e916299c0) has no exports 00000100:00100000:0.0:1788930021.203936:0:11024:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8d2eb59f2600:11024] 3 exiting: rc = 0 00000100:00100000:0.0:1788930021.204038:0:5839:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8d2e8657c200:5839] 0 exiting: rc = 1 00000100:00100000:2.0:1788930021.206744:0:5841:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8d2e8639da00:5841] 2 exiting: rc = 0 00000100:00100000:2.0:1788930021.206863:0:5840:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8d2e86384a00:5840] 1 exiting: rc = 0 00000100:00100000:0.0:1788930021.207073:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207082:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207088:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207093:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207098:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207102:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207108:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207113:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207118:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207123:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207137:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207144:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207150:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207163:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207169:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207175:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207180:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207185:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207190:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207195:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207201:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207206:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207211:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207216:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207238:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207245:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207251:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207256:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207261:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207267:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207272:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207278:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207283:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207288:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207295:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207317:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207324:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207330:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207343:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207349:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207355:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207360:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207366:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207384:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207391:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207398:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207405:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207412:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207419:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207424:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207430:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207436:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207441:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207447:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207452:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207458:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207463:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207480:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207488:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207494:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207500:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207505:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207512:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.207517:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.217138:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d2e86385c00:5842] 0 exiting: rc = 1 00000100:00100000:0.0:1788930021.218313:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d2e8639c600:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1788930021.218515:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218527:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218534:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218542:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218548:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218636:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218643:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218649:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218655:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218660:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218667:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218672:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218680:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218687:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218692:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218697:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218702:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218708:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218713:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218717:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218722:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218727:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218732:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218737:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218741:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218747:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218752:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218758:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218763:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218769:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218774:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218778:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218784:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218790:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218794:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218799:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218804:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218810:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218816:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218821:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218833:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218838:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218844:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218849:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218853:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218859:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218864:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218869:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218874:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218880:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218885:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218890:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218895:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218900:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218905:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218910:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218976:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218985:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218991:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.218996:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.219001:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.219006:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.219011:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.219017:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220116:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8d2e8635ac00:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1788930021.220267:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8d2e8635b600:5844] 0 exiting: rc = 1 00000100:00100000:0.0:1788930021.220374:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220382:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220388:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220394:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220401:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220477:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220484:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220490:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220507:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220514:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220525:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220531:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220537:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220542:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220548:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220555:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220624:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220633:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220639:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220644:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220663:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220669:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220679:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220685:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220690:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220697:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220703:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220710:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220715:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220721:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220727:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220734:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220751:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220758:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220764:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220770:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220776:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220781:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220787:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220793:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220799:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220804:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220810:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220816:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220833:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220844:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220849:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220856:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220863:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220869:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220874:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220880:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220885:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220892:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220898:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.220904:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.221013:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.221021:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.221026:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.221033:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.221039:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.221045:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.221050:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.221057:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.242797:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d2e8635a200:5847] 1 exiting: rc = 0 00000100:00100000:0.0:1788930021.243244:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d2e8635aa00:5846] 0 exiting: rc = 1 00000100:00100000:1.0:1788930021.243515:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243522:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243527:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243533:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243539:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243545:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243550:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243554:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243569:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243574:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243580:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243584:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243589:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243593:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243598:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243603:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243607:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243612:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243617:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243623:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243628:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243633:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243646:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243651:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243656:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243662:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243667:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243672:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243677:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243681:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243686:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243691:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243697:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243702:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243723:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243728:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243733:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243738:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243744:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243748:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243754:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243759:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243764:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243769:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243774:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243779:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243784:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243788:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243793:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243797:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243802:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243806:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243811:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243816:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243821:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243826:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243830:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243835:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243840:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243845:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243850:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243855:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243861:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.243866:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.244566:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d2e8635be00:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1788930021.244812:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d2e8635a400:5848] 0 exiting: rc = 1 00000100:00100000:1.0:1788930021.245002:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245009:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245015:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245020:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245025:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245038:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245043:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245049:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245055:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245061:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245066:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245071:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245076:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245081:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245086:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245092:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245097:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245103:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245108:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245113:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245119:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245124:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245130:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245134:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245139:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245144:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245150:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245164:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245170:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245175:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245181:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245186:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245191:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245196:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245201:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245206:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245211:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245216:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245249:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245256:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245269:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245275:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245280:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245286:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245290:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245296:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245301:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245306:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245311:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245316:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245321:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245326:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245330:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245335:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245339:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245345:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245350:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245355:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245360:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245366:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245371:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245377:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245382:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.245387:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.246022:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d2e865d3200:5851] 1 exiting: rc = 0 00000100:00100000:2.0:1788930021.246403:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d2e8635a000:5850] 0 exiting: rc = 1 00000100:00100000:1.0:1788930021.246660:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246667:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246672:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246677:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246682:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246687:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246691:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246696:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246701:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246705:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246709:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246724:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246729:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246733:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246738:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246743:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246748:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246753:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246758:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246762:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246766:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246771:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246777:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246781:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246786:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246791:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246795:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246800:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246805:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246809:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246814:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246819:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246824:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246831:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246836:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246840:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246845:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246850:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246855:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246860:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246866:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246871:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246877:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246882:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246886:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246891:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246904:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246908:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246913:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246929:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246934:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246939:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246944:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246949:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246954:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246959:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246963:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246967:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246973:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246977:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246982:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246987:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246992:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.246997:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930021.248119:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8d2e8635b400:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1788930021.249030:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8d2e865d2e00:5853] 1 exiting: rc = 0 00000100:00100000:3.0:1788930021.249205:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8d2e865d2a00:5854] 2 exiting: rc = 0 00000100:00100000:1.0:1788930021.256592:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256603:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256609:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256614:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256620:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256626:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256634:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256685:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256692:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256698:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256704:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256710:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256720:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256726:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256732:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256738:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256744:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256766:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256771:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256776:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256781:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256786:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256791:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256797:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256803:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256809:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256815:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256821:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256827:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256834:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256841:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256863:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256870:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256875:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256881:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256886:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256892:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256898:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256904:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256921:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256929:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256935:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256940:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256946:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256953:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256959:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256964:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256970:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256976:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256981:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256986:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.256991:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.257003:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.257009:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.257015:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.257035:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.257041:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.257046:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.257052:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.257058:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.257063:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.257068:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.257074:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930021.257088:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788930021.266989:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788930021.267006:0:13012:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788930021.267014:0:13012:0:(genops.c:885:class_export_put()) final put ffff8d2e864c3800/MDS_uuid 00000020:00000080:1.0:1788930021.267019:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e864c3800/MDS_uuid for MDS 00000020:01000000:1.0:1788930021.267033:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788930021.267797:0:13012:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:3.0:1788930021.448094:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788930021.448105:0:7639:0:(genops.c:885:class_export_put()) final put ffff8d2e87c55800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788930021.448770:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e87c55800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788930021.448836:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e87c53000 for lustre-OST0001 00010000:00010000:0.0:1788930021.788444:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930022.816180:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930023.835384:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788930023.933481:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788930023.933491:0:6716:0:(genops.c:885:class_export_put()) final put ffff8d2d84876800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788930023.933530:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84876800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788930023.933574:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d84872800 for lustre-OST0000 00000100:00100000:2.0:1788930024.411740:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788930024.411762:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770166528:0@lo:400:kworker.0 00000400:00000100:2.0:1788930024.411827:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875828770166528 offset 0 length 224: 4 00000100:00100000:2.0:1788930024.411898:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770166784:0@lo:400:kworker.0 00000400:00000100:2.0:1788930024.411919:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875828770166784 offset 0 length 224: 4 00000100:00100000:2.0:1788930024.411933:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788930024.411938:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770166656:0@lo:400:kworker.0 00000400:00000100:2.0:1788930024.411953:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875828770166656 offset 0 length 224: 4 00000020:01000004:0.0:1788930024.456664:0:13162:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788930024.478715:0:13162:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788930024.479250:0:13162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930024.479631:0:13162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930024.479657:0:13162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930024.479663:0:13162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930024.479686:0:13162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788930024.479691:0:13162:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788930024.479715:0:13162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788930024.479728:0:13162:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2d8437a680 x1875828770166656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788930024.479927:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930024.479936:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930024.479944:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e80031c00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:2.0:1788930024.479948:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930024.479957:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788930024.479965:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930024.479970:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788930024.479973:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788930024.479975:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788930024.480018:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930024.480032:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788930024.480063:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930024.480070:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e80031c00/0xce4472dd2237c917 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237c91e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930024.480085:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930024.480087:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930024.480088:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930024.480114:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770166912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788930024.480285:0:13162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788930024.480292:0:13162:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788930024.480307:0:13162:0:(import.c:65:import_set_state_nolock()) ffff8d2e85c17000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788930024.481305:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930024.481377:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875828770167040:0@lo:39:umount.0 00000400:00000100:2.0:1788930024.481403:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875828770167040 offset 0 length 224: 4 00000100:00100000:0.0:1788930024.485282:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770166912 00000100:00100000:0.0:1788930024.485299:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770166912 00000100:00100000:0.0:1788930024.485350:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788930024.485359:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3310:x1875828770166912:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788930024.485368:0:5826:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788930024 with bad export cookie 14863130964316898802 00000100:00100000:1.0:1788930024.491990:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770166656:0@lo:400:kworker.0 00000100:00100000:0.0:1788930024.504831:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3310:x1875828770166912:12345-0@lo:103:ldlm_bl.0 Request processed in 19461us (23518us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788930024.504859:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788930024.505159:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788930024.505165:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d2e87c00000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788930024.505169:0:3310:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788930024.519058:0:3310:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.140@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788930024.519063:0:3310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788930024.519073:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2d8437bb80 x1875828770166528/t0(0) o400->MGC192.168.204.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788930040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930024.519087:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2d85135500 x1875828770166912/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788930040 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788930024.519096:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788930024.519098:0:3310:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788930024.519099:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788930024.519103:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d2e87c00000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788930024.519124:0:3310:0:(import.c:545:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 172 00000100:00080000:2.0:1788930024.519203:0:3310:0:(import.c:666:import_select_connection()) MGC192.168.204.140@tcp: import ffff8d2e87c00000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1788930024.519612:0:3310:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d85137100 x1875828770167168/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788930024.519681:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bddba76f-ee04-4b28-985b-cc9b0811bff7:3307:1875828770167168:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788930024.519733:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875828770167168 offset 0 length 520: 4 00000100:00100000:2.0:1788930024.519839:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770166528:0@lo:400:kworker.0 00000100:00100000:2.0:1788930024.519935:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bddba76f-ee04-4b28-985b-cc9b0811bff7:3310:1875828770166912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788930024.861398:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930025.883432:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930026.907460:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930027.932980:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930028.955391:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788930029.532391:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) bddba76f-ee04-4b28-985b-cc9b0811bff7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788930029.532402:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) bddba76f-ee04-4b28-985b-cc9b0811bff7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788930029.532511:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788930029.532530:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770167296:0@lo:400:kworker.0 00000400:00000100:2.0:1788930029.532595:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875828770167296 offset 0 length 224: 4 00010000:00010000:2.0:1788930029.979635:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930031.003904:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930032.028200:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930033.052562:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930034.079475:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788930034.653297:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) bddba76f-ee04-4b28-985b-cc9b0811bff7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788930034.653311:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) bddba76f-ee04-4b28-985b-cc9b0811bff7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788930034.653639:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788930024/real 1788930024] req@ffff8d2d85137100 x1875828770167168/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788930034 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930034.653683:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2d85137100 x1875828770167168/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788930034 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930034.653695:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788930024/real 1788930024] req@ffff8d2d84378e00 x1875828770167040/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788930034 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930034.653753:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2d84378e00 x1875828770167040/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788930034 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788930034.653771:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e87c00000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788930034.653793:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788930034.653797:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bddba76f-ee04-4b28-985b-cc9b0811bff7:3307:1875828770167168:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1788930034.653803:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e85c17000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788930034.653814:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875828770167040:0@lo:39:umount.0 00000100:00080000:0.0:1788930034.653857:0:13162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788930034.653861:0:13162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788930034.653866:0:13162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788930034.654834:0:13162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930034.654852:0:13162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930034.654861:0:13162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930034.654908:0:13162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930034.654935:0:13162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788930034.654943:0:13162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930034.654950:0:13162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930034.654956:0:13162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930034.654963:0:13162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930034.654975:0:13162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788930034.654979:0:13162:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788930034.655006:0:13162:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788930034.655011:0:13162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788930034.655015:0:13162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788930034.655021:0:13162:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788930034.655025:0:13162:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8d2e87ca8000) has no exports 00000020:00080000:0.0:1788930034.655052:0:13162:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8d2e87ca8000) has no exports 00000100:00100000:3.0:1788930034.655338:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788930034.655360:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770167424:0@lo:400:kworker.0 00000400:00000100:3.0:1788930034.655412:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875828770167424 offset 0 length 224: 4 00010000:00010000:3.0:1788930034.655509:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788930034.655516:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930034.655524:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597e00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:3.0:1788930034.655528:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930034.655537:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788930034.655553:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930034.655559:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788930034.655561:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788930034.655564:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788930034.655577:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2e87c00000 00010000:00010000:3.0:1788930034.655581:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930034.655588:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597e00/0xce4472dd2237c925 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237c92c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930034.655601:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930034.655604:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930034.655610:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596c00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:3.0:1788930034.655613:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930034.655620:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788930034.655626:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930034.655631:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788930034.655633:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788930034.655639:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788930034.655644:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2e87c00000 00010000:00010000:3.0:1788930034.655648:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930034.655654:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237cb40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237cb47 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930034.655662:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930034.655664:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930034.655666:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930034.657020:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788930034.657046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) bddba76f-ee04-4b28-985b-cc9b0811bff7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788930034.657052:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788930034.657056:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d2e87c00000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788930034.657065:0:36:0:(import.c:545:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 409 00000100:00080000:2.0:1788930034.657072:0:36:0:(import.c:630:import_select_connection()) MGC192.168.204.140@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788930034.657085:0:36:0:(import.c:666:import_select_connection()) MGC192.168.204.140@tcp: import ffff8d2e87c00000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1788930034.657122:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d85136a00 x1875828770167552/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788930034.657294:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bddba76f-ee04-4b28-985b-cc9b0811bff7:3307:1875828770167552:0@lo:250:kworker.0 00000400:00000100:1.0:1788930034.657362:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875828770167552 offset 0 length 520: 4 00000020:01000000:0.0:1788930034.662801:0:13162:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2e87f35960 - data ffff8d2ebb33c1b0/ffff8d2ebcccec00 00000020:01000000:0.0:1788930034.662955:0:13162:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2e87c2da20 - data ffff8d2eacbf3bd0/ffff8d2d84287c00 00100000:10000000:0.0:1788930034.675799:0:13162:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788930034.702109:0:13162:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c718 00000020:00000080:3.0:1788930034.702120:0:13162:0:(genops.c:885:class_export_put()) final put ffff8d2d84874800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788930034.702144:0:13162:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2eb5357800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788930034.702148:0:13162:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2eb5357800 2 00000020:01000004:3.0:1788930034.702151:0:13162:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2eb5357800 from lustre-OST0000 00000020:00000080:3.0:1788930034.702260:0:13162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788930034.702271:0:13162:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788930034.702276:0:13162:0:(genops.c:885:class_export_put()) final put ffff8d2d84875000/lustre-OST0000_UUID 00000020:00000080:3.0:1788930034.702279:0:13162:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84875000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788930034.702290:0:13162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:0.0:1788930034.702387:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84874800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1788930034.702483:0:13162:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788930034.702488:0:13162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788930034.702491:0:13162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788930034.702496:0:13162:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788930034.702502:0:13162:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d2d84b5f000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788930034.702508:0:13162:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8d2eb728cd40) has exports, disconnecting them 00000020:00080000:3.0:1788930034.702513:0:13162:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d2d84b5f000), last request at 1788929805 00000020:00000080:3.0:1788930034.702517:0:13162:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c742 00000020:00080000:3.0:1788930034.702525:0:13162:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2d84b5f000): rc 0 00000020:00000080:3.0:1788930034.702531:0:13162:0:(genops.c:885:class_export_put()) final put ffff8d2d84b5f000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788930034.702803:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84b5f000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788930034.708327:0:13162:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788930034.708337:0:13162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788930034.708342:0:13162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788930034.708350:0:13162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788930034.708534:0:13162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788930034.708543:0:13162:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788930034.708549:0:13162:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2eb5357800 1 00000020:00000080:0.0:1788930034.708556:0:13162:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c6d2 00000020:00000080:0.0:1788930034.708565:0:13162:0:(genops.c:885:class_export_put()) final put ffff8d2eb729e800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788930034.708570:0:13162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788930034.708575:0:13162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788930034.708580:0:13162:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788930034.708584:0:13162:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8d2e91628000) has no exports 00000020:00000080:1.0:1788930034.708805:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e85c17000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788930034.708813:0:36:0:(genops.c:885:class_export_put()) final put ffff8d2d84b5c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788930034.708816:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84b5c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788930034.708826:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788930034.708901:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb729e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788930034.726041:0:13162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788930034.726057:0:13162:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788930034.726063:0:13162:0:(genops.c:885:class_export_put()) final put ffff8d2eb5354800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788930034.726068:0:13162:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5354800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788930034.726075:0:13162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788930034.726242:0:13162:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d2eb5351800 00000020:02000400:1.0:1788930034.726287:0:13162:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788930035.099795:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930036.125974:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930037.147462:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788930037.333630:0:13314:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788930037.371817:0:13314:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788930037.371913:0:13314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930037.371929:0:13314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930037.371936:0:13314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930037.371943:0:13314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930037.372035:0:13314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788930037.372042:0:13314:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788930037.372063:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788930037.372075:0:13314:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2d84379c00 x1875828770166784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930037.372102:0:13314:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2d85d3f800 x1875828770167296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930045 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930037.374488:0:13314:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2d85135500 x1875828770167424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930050 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930037.374504:0:13314:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788930037.374512:0:13314:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788930037.374545:0:13314:0:(import.c:65:import_set_state_nolock()) ffff8d2d85d87800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788930037.374939:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770167296:0@lo:400:kworker.0 00000100:00100000:1.0:1788930037.374975:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875828770167680:0@lo:39:umount.0 00000400:00000100:1.0:1788930037.375037:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875828770167680 offset 0 length 224: 4 00000100:00100000:3.0:1788930037.375308:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770167424:0@lo:400:kworker.0 00000100:00100000:3.0:1788930037.375317:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770166784:0@lo:400:kworker.0 00010000:00010000:0.0:1788930037.382631:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930037.382648:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930037.382660:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e80031a00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788930037.382664:0:7628:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930037.382675:0:7628:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788930037.382682:0:7628:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930037.382687:0:7628:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788930037.382689:0:7628:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788930037.382713:0:7628:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788930037.382733:0:7628:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2e87c00000 00010000:00010000:0.0:1788930037.382736:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930037.382743:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e80031a00/0xce4472dd2237c8fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237c902 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930037.382761:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930037.382763:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930037.382764:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930038.171426:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930039.196201:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788930039.776013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) bddba76f-ee04-4b28-985b-cc9b0811bff7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788930039.776024:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) bddba76f-ee04-4b28-985b-cc9b0811bff7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788930040.221193:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930041.243701:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930042.267653:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930043.291785:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930044.315394:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788930044.891411:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) bddba76f-ee04-4b28-985b-cc9b0811bff7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788930044.891424:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) bddba76f-ee04-4b28-985b-cc9b0811bff7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788930045.339749:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930046.365185:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930047.387410:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930047.579490:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788930037/real 1788930037] req@ffff8d2d85135180 x1875828770167680/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788930047 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930047.579529:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2d85135180 x1875828770167680/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788930047 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788930047.579552:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2d85d87800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788930047.579574:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875828770167680:0@lo:39:umount.0 00000100:00080000:2.0:1788930047.579734:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788930047.579740:0:13314:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788930047.579765:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788930047.581105:0:13314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930047.581123:0:13314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930047.581131:0:13314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930047.581138:0:13314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930047.581169:0:13314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930047.581178:0:13314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930047.581185:0:13314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930047.581192:0:13314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930047.581198:0:13314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930047.581246:0:13314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788930047.581251:0:13314:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:3.0:1788930047.581892:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788930047.581901:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930047.581909:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341a00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:3.0:1788930047.581912:0:7628:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930047.581921:0:7628:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788930047.581928:0:7628:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930047.581934:0:7628:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788930047.581937:0:7628:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788930047.581939:0:7628:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788930047.581954:0:7628:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2e87c00000 00010000:00010000:3.0:1788930047.581959:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930047.582013:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341a00/0xce4472dd2237c909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237c910 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930047.582029:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930047.582032:0:7628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930047.582038:0:7628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597a00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:3.0:1788930047.582041:0:7628:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930047.582048:0:7628:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788930047.582054:0:7628:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930047.582058:0:7628:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788930047.582060:0:7628:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788930047.582063:0:7628:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788930047.582068:0:7628:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2e87c00000 00010000:00010000:3.0:1788930047.582071:0:7628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930047.582077:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebc597a00/0xce4472dd2237cb32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237cb39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930047.582091:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930047.582092:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930047.582100:0:7628:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788930047.582153:0:13314:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788930047.582158:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788930047.582163:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788930047.582174:0:13314:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:0.0:1788930047.582612:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788930047.582673:0:13314:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8d2eb5b8cd40) has no exports 00000020:00080000:2.0:1788930047.582712:0:13314:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8d2eb5b8cd40) has no exports 00000020:01000000:2.0:1788930047.586569:0:13314:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2e87f35600 - data ffff8d2ebb33c288/ffff8d2ebcccc800 00000020:01000000:2.0:1788930047.586742:0:13314:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2eb59811e0 - data ffff8d2eacb6f0d8/ffff8d2ebc3e9400 00100000:10000000:0.0:1788930047.600044:0:13314:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788930047.643899:0:13314:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c7f1 00000020:00000080:3.0:1788930047.643912:0:13314:0:(genops.c:885:class_export_put()) final put ffff8d2eb5b85800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788930047.643987:0:13314:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2d85d86800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788930047.643991:0:13314:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2d85d86800 2 00000020:01000004:3.0:1788930047.643995:0:13314:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2d85d86800 from lustre-OST0001 00000020:00000080:3.0:1788930047.644020:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788930047.644032:0:13314:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788930047.644058:0:13314:0:(genops.c:885:class_export_put()) final put ffff8d2eb5b87000/lustre-OST0001_UUID 00000020:00000080:3.0:1788930047.644061:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5b87000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788930047.644125:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788930047.644291:0:13314:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import bddba76f-ee04-4b28-985b-cc9b0811bff7->MGS 00010000:00010000:3.0:1788930047.644410:0:13314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e80030e00/0xce4472dd2237c6f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237c6fc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788930047.644490:0:13314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e80030e00/0xce4472dd2237c6f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237c6fc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930047.644498:0:13314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788930047.644501:0:13314:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788930047.644504:0:13314:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788930047.644620:0:13314:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2e87c00000 00010000:00010000:3.0:1788930047.644626:0:13314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e80030e00/0xce4472dd2237c6f5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237c6fc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930047.644644:0:13314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237c94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237c956 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788930047.644651:0:13314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237c94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237c956 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930047.644656:0:13314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788930047.644671:0:13314:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788930047.644673:0:13314:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788930047.644685:0:13314:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2e87c00000 00010000:00010000:3.0:1788930047.644687:0:13314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237c94f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237c956 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788930047.644705:0:13314:0:(import.c:65:import_set_state_nolock()) ffff8d2e87c00000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788930047.644709:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788930047.644711:0:13314:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788930047.644713:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788930047.644718:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788930047.644729:0:13314:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2d85136a00 x1875828770167552/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788930049 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788930047.644757:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788930047.644761:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1788930047.644946:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bddba76f-ee04-4b28-985b-cc9b0811bff7:3307:1875828770167552:0@lo:250:kworker.0 10000000:01000000:3.0:1788930047.645022:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788930047.645030:0:13314:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c5e4 00000020:00000080:3.0:1788930047.645035:0:13314:0:(genops.c:885:class_export_put()) final put ffff8d2e864c3000/bddba76f-ee04-4b28-985b-cc9b0811bff7 00000020:00000080:2.0:1788930047.647702:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5b85800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788930047.647938:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.140@tcp (flags='') 00000020:00000080:3.0:1788930047.647951:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788930047.647959:0:13314:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.140@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788930047.647964:0:13314:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8d2e8637b380) has no exports 10000000:01000000:1.0:1788930047.648249:0:5837:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788930047.648391:0:13314:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.140@tcp: client import never connected 00000100:00080000:3.0:1788930047.648396:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788930047.648401:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788930047.648550:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788930047.648553:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788930047.648790:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e864c3000/bddba76f-ee04-4b28-985b-cc9b0811bff7 for MGC192.168.204.140@tcp 00000020:00000080:2.0:1788930047.648932:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e87c00000 for MGC192.168.204.140@tcp 00000020:00000080:3.0:1788930047.648937:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788930047.648947:0:13314:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.140@tcp (uuid bddba76f-ee04-4b28-985b-cc9b0811bff7) 00000020:00000080:3.0:1788930047.648952:0:13314:0:(genops.c:885:class_export_put()) final put ffff8d2e87c02000/bddba76f-ee04-4b28-985b-cc9b0811bff7 00000020:00000080:3.0:1788930047.648954:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e87c02000/bddba76f-ee04-4b28-985b-cc9b0811bff7 for MGC192.168.204.140@tcp 00000020:01000000:3.0:1788930047.648960:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.140@tcp (bddba76f-ee04-4b28-985b-cc9b0811bff7) 00000020:01000000:3.0:1788930047.651789:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788930047.651802:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788930047.651814:0:13314:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788930047.651903:0:13314:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d2d84b5f800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788930047.651910:0:13314:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8d2ebccd19c0) has exports, disconnecting them 00000020:00080000:3.0:1788930047.651916:0:13314:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d2d84b5f800), last request at 1788929823 00000020:00000080:3.0:1788930047.651922:0:13314:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c81b 00000020:00080000:3.0:1788930047.651946:0:13314:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2d84b5f800): rc 0 00000020:00000080:3.0:1788930047.651952:0:13314:0:(genops.c:885:class_export_put()) final put ffff8d2d84b5f800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788930047.652077:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84b5f800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788930047.655546:0:13314:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788930047.655557:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788930047.655561:0:13314:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788930047.655568:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788930047.655682:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788930047.656073:0:7628:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:1.0:1788930047.656434:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d85d87800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788930047.656914:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788930047.657368:0:8446:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8d2e984b4e00:8446] 2 exiting: rc = 0 00000100:00100000:1.0:1788930047.657445:0:5822:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d2e9059a600:5822] 0 exiting: rc = 1 00000100:00100000:0.0:1788930047.658550:0:5823:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d2e90332000:5823] 1 exiting: rc = 0 00000100:00100000:2.0:1788930047.658670:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.659474:0:7629:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d2ebc28a200:7629] 3 exiting: rc = 0 00000100:00100000:2.0:1788930047.659556:0:5825:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d2e82a52000:5825] 1 exiting: rc = 0 00000100:00100000:0.0:1788930047.659632:0:5826:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d2e90332c00:5826] 2 exiting: rc = 0 00000100:00100000:2.0:1788930047.661343:0:5824:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d2e9059ac00:5824] 0 exiting: rc = 1 00000100:00100000:1.0:1788930047.661778:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661788:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661794:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661801:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661807:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661814:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661896:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661902:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661908:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661914:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661922:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661929:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661934:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661942:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661948:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661953:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661959:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661964:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.661969:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662046:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662054:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662059:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662064:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662069:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662074:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662079:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662085:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662091:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662096:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662101:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662106:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662111:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662117:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662122:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662127:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662132:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662137:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662143:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662214:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662220:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662251:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662264:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662269:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662275:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662279:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662284:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662290:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662295:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662300:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662305:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662311:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662317:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662322:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662330:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662335:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662341:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662346:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662351:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662356:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662363:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662368:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662372:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662377:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.662381:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788930047.664074:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788930047.664089:0:13314:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788930047.664098:0:13314:0:(genops.c:885:class_export_put()) final put ffff8d2eb5427000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788930047.664104:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5427000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788930047.664111:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788930047.664263:0:13314:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2d85d86800 1 00000020:00000080:1.0:1788930047.664271:0:13314:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237c7c0 00000020:00000080:1.0:1788930047.664279:0:13314:0:(genops.c:885:class_export_put()) final put ffff8d2d85eb8000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788930047.664294:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788930047.664299:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788930047.664306:0:13314:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788930047.664321:0:13314:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8d2eb72899c0) has no exports 00000020:00000080:2.0:1788930047.664762:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d85eb8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788930047.689163:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788930047.689180:0:13314:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788930047.689185:0:13314:0:(genops.c:885:class_export_put()) final put ffff8d2d85d83000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788930047.689190:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d85d83000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788930047.689197:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788930047.689403:0:13314:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d2d85d80800 00000020:01000000:2.0:1788930047.690373:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788930047.690386:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788930047.690393:0:13314:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788930047.690399:0:13314:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8d2eb728b380) has no exports 00000020:00000080:2.0:1788930047.690438:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788930047.690464:0:13314:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788930047.690468:0:13314:0:(genops.c:885:class_export_put()) final put ffff8d2eb729c800/OSS_uuid 00000020:00000080:2.0:1788930047.690471:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb729c800/OSS_uuid for OSS 00000020:01000000:2.0:1788930047.690477:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788930047.690586:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8d2eb5ae6c00:6687] 1 exiting: rc = 0 00000100:00100000:2.0:1788930047.690795:0:12006:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8d2d848be600:12006] 4 exiting: rc = 0 00000100:00100000:2.0:1788930047.690909:0:6989:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8d2e90af6400:6989] 3 exiting: rc = 0 00000100:00100000:2.0:1788930047.692260:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8d2e936bac00:6688] 2 exiting: rc = 0 00000100:00080000:2.0:1788930047.692336:0:5835:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788930047.695355:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8d2eb5ae6600:6685] 0 exiting: rc = 1 00000100:00100000:2.0:1788930047.695670:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695678:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695685:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695694:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695699:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695706:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695711:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695716:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695723:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695729:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695734:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695740:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695746:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695751:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695757:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695761:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695767:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695773:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695778:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695784:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695790:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695795:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695801:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695807:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695813:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695845:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695851:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695856:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695861:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695866:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695871:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695876:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695882:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695888:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695895:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695902:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695907:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695913:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695919:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695926:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695933:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695939:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695944:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695949:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695955:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695961:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695966:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695981:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695987:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695992:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.695998:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.696003:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.696009:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.696016:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.696021:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.696027:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.696036:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.696044:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.696051:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.696057:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.696071:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.696077:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.696083:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930047.696089:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930047.706155:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d2eb5ae7a00:6689] 0 exiting: rc = 1 00000100:00100000:2.0:1788930047.712572:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d2eb5ae6000:6690] 1 exiting: rc = 0 00000100:00100000:1.0:1788930047.726312:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726325:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726330:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726336:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726340:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726346:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726352:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726361:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726366:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726371:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726377:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726382:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726387:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726392:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726396:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726401:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726406:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726411:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726416:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726421:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726427:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726432:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726437:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726448:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726453:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726458:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726463:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726468:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726473:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726478:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726483:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726489:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726494:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726521:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726526:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726531:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726536:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726541:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726546:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726553:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726557:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726562:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726566:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726571:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726576:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726580:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726585:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726590:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726595:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726600:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726605:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726610:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726615:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726620:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.726626:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.727028:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.727039:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.727043:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.727049:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.727054:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.727059:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.727065:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.727070:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.727076:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.731592:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d2eb5ae7400:6691] 0 exiting: rc = 1 00000100:00100000:0.0:1788930047.736085:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d2e89074c00:6693] 2 exiting: rc = 0 00000100:00100000:3.0:1788930047.740239:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d2e936bbe00:6692] 1 exiting: rc = 0 00000100:00100000:1.0:1788930047.740469:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740478:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740485:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740526:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740534:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740542:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740548:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740554:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740559:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740565:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740576:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740584:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740590:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740596:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740602:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740608:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740615:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740620:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740626:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740634:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740640:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740645:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740723:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740730:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740735:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740741:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740747:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740766:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740772:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740778:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740784:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740790:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740796:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740801:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740808:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740888:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740898:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740905:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740918:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740925:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740932:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740939:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740945:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740952:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740958:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740963:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740970:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740985:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740992:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.740998:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741003:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741009:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741016:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741024:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741030:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741036:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741122:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741130:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741139:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741145:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741151:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741156:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741161:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.741168:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750338:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d2e984b0400:6694] 0 exiting: rc = 1 00000100:00100000:1.0:1788930047.750471:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d2eb5d45600:6695] 1 exiting: rc = 0 00000100:00100000:1.0:1788930047.750531:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750540:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750548:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750554:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750561:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750568:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750574:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750598:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750604:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750610:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750616:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750623:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750629:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750634:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750640:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.750646:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.751788:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.751800:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.751805:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.751811:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752092:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752102:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752107:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752113:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752118:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752124:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752129:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752135:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752141:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752147:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752152:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752157:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752162:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752167:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752172:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752177:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752183:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752188:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752195:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752200:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752206:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752211:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752269:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752275:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752280:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752290:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752295:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752300:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752306:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752312:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752317:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752324:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752329:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752336:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752343:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752348:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752354:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752359:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752368:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752373:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752378:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752384:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752390:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.752396:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.766498:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d2ebc592200:6696] 0 exiting: rc = 1 00000100:00100000:0.0:1788930047.774648:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d2ebc592800:6697] 1 exiting: rc = 0 00000100:00100000:1.0:1788930047.780968:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.780992:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781015:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781027:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781035:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781050:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781057:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781065:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781073:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781081:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781091:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781120:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781141:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781147:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781154:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781163:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781174:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781180:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781187:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781194:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781200:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781206:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781213:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781422:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781434:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781444:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781452:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781461:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781470:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781481:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781489:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781498:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781506:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781514:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781524:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781553:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781564:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781575:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781582:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781588:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781594:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781600:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781608:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781614:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781620:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781626:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.781632:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782439:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782449:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782455:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782461:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782468:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782476:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782483:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782491:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782500:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782511:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782519:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782525:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782556:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782565:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782573:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782583:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930047.782591:0:13314:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788930047.807413:0:13314:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788930067.457129:0:13942:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788930077.824297:0:14404:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788930077.824303:0:14404:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788930077.824585:0:14404:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2ebe0db800 00000020:01000004:3.0:1788930077.824601:0:14404:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788930077.824610:0:14404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788930077.824624:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d2eb5b8cd40) 00000020:00000080:3.0:1788930077.824640:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788930077.886624:0:14404:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788930077.897347:0:14404:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788930077.899122:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 515: rc = 0 00100000:10000000:2.0:1788930077.899552:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 515: rc = 0 00100000:10000000:2.0:1788930077.900195:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 515: rc = 0 00100000:10000000:2.0:1788930077.900419:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 515: rc = 0 00100000:10000000:2.0:1788930077.900537:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 515: rc = 0 00100000:10000000:2.0:1788930077.900777:0:14404:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788930077.901030:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 515: rc = 0 00100000:10000000:2.0:1788930077.901343:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 517: rc = 0 00100000:10000000:1.0:1788930077.923273:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 630: rc = 0 00100000:10000000:1.0:1788930077.924050:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 630: rc = 0 00100000:10000000:1.0:1788930077.928342:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 454: rc = 0 00100000:10000000:1.0:1788930077.933780:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 454: rc = 0 00100000:10000000:1.0:1788930077.934374:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 454: rc = 0 00100000:10000000:1.0:1788930077.936401:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 454: rc = 0 00100000:10000000:1.0:1788930077.936727:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 454: rc = 0 00100000:10000000:1.0:1788930077.937010:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 454: rc = 0 00100000:10000000:1.0:1788930077.937287:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 454: rc = 0 00100000:10000000:1.0:1788930077.937583:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 454: rc = 0 00100000:10000000:1.0:1788930077.937829:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 454: rc = 0 00100000:10000000:1.0:1788930077.938073:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 454: rc = 0 00100000:10000000:1.0:1788930077.939646:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 454: rc = 0 00100000:10000000:1.0:1788930077.940599:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 454: rc = 0 00100000:10000000:1.0:1788930077.942318:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 465: rc = 0 00100000:10000000:1.0:1788930077.943128:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 465: rc = 0 00100000:10000000:1.0:1788930077.943673:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 465: rc = 0 00100000:10000000:1.0:1788930077.947217:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 465: rc = 0 00100000:10000000:1.0:1788930077.948673:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 465: rc = 0 00100000:10000000:1.0:1788930077.949370:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 465: rc = 0 00100000:10000000:1.0:1788930077.950193:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 465: rc = 0 00100000:10000000:1.0:1788930077.950681:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 465: rc = 0 00100000:10000000:1.0:1788930077.951142:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 465: rc = 0 00100000:10000000:1.0:1788930077.952175:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 465: rc = 0 00100000:10000000:0.0:1788930077.954572:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 465: rc = 0 00100000:10000000:0.0:1788930077.955127:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 465: rc = 0 00100000:10000000:0.0:1788930077.955613:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 465: rc = 0 00100000:10000000:0.0:1788930077.956217:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 465: rc = 0 00100000:10000000:0.0:1788930077.957249:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 465: rc = 0 00100000:10000000:0.0:1788930077.958041:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 465: rc = 0 00100000:10000000:0.0:1788930077.959054:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 465: rc = 0 00100000:10000000:0.0:1788930077.960697:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 465: rc = 0 00100000:10000000:0.0:1788930077.963063:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 465: rc = 0 00100000:10000000:0.0:1788930077.964713:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 465: rc = 0 00100000:10000000:0.0:1788930077.968136:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 465: rc = 0 00100000:10000000:0.0:1788930077.969998:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 465: rc = 0 00100000:10000000:0.0:1788930077.971365:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 465: rc = 0 00100000:10000000:0.0:1788930077.971696:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 465: rc = 0 00100000:10000000:0.0:1788930077.971980:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 465: rc = 0 00100000:10000000:0.0:1788930077.972274:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 465: rc = 0 00100000:10000000:0.0:1788930077.972530:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 465: rc = 0 00100000:10000000:0.0:1788930077.972765:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 465: rc = 0 00100000:10000000:0.0:1788930077.973030:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 465: rc = 0 00100000:10000000:0.0:1788930077.973335:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 465: rc = 0 00100000:10000000:0.0:1788930077.973614:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 465: rc = 0 00100000:10000000:0.0:1788930077.978942:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 465: rc = 0 00100000:10000000:0.0:1788930077.980104:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 355: rc = 0 00100000:10000000:0.0:1788930077.982309:0:14404:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788930077.983188:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 200: rc = 0 00100000:10000000:0.0:1788930077.984359:0:14404:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788930077.985152:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 200: rc = 0 00100000:10000000:2.0:1788930077.987075:0:14404:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788930077.987176:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 200: rc = 0 00100000:10000000:3.0:1788930077.988570:0:14404:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788930077.988663:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 631: rc = 0 00100000:10000000:3.0:1788930077.990038:0:14404:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788930077.990124:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 631: rc = 0 00100000:10000000:3.0:1788930077.990595:0:14404:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788930077.990679:0:14404:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 631: rc = 0 00000020:00000080:3.0:1788930077.993968:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788930077.993983:0:14404:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788930077.994001:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237d8d7 00000020:01000004:3.0:1788930077.994013:0:14404:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788930077.994037:0:14404:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788930077.994045:0:14404:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2ebe0db800 from MGS 00000020:01000004:3.0:1788930077.994050:0:14404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788930077.994068:0:14404:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d2eb5b899c0) 00000020:00000080:3.0:1788930077.994088:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788930077.994157:0:14404:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2ebe0db800 from MGS, refs=2 00080000:01000000:3.0:1788930077.994164:0:14404:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788930077.994169:0:14404:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237d8e5 00000100:00100000:3.0:1788930077.994340:0:14404:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788930077.996007:0:14404:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788930077.996019:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788930077.998080:0:14404:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788930077.998094:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788930078.000044:0:14404:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788930078.000354:0:14404:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788930078.000361:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788930078.006828:0:14404:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788930078.006847:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788930078.014359:0:14404:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788930078.014570:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788930078.018564:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930078.018572:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930078.018575:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930078.021141:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930078.021148:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930078.021151:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930078.022166:0:14404:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788930078.027873:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788930078.034115:0:14404:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788930078.034140:0:14404:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788930078.034142:0:14404:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788930078.048249:0:14414:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788930078.048521:0:14404:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788930078.048638:0:14404:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788930078.049892:0:14404:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788930078.050215:0:14404:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788930078.052941:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788930078.052949:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788930078.054141:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788930078.054151:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788930078.062894:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788930078.062907:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788930078.063768:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788930078.063790:0:14404:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.140@tcp' 00000020:01000004:3.0:1788930078.063792:0:14404:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788930078.063830:0:14404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.140@tcp (typ=mgc) 00000020:00000080:3.0:1788930078.063844:0:14404:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.140@tcp (ffff8d2eb5b88000) 00000020:00000080:3.0:1788930078.063860:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788930078.063932:0:14404:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2ebc281000@MGC192.168.204.140@tcp: add connection 192.168.204.140@tcp at head 00010000:00010000:3.0:1788930078.064081:0:14404:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.140@tcp-0 is initialized 00000040:01000000:3.0:1788930078.064088:0:14404:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788930078.064723:0:14418:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788930078.067528:0:14419:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788930078.067621:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.140@tcp (uuid 3e0889e5-a3a3-4d3e-b42f-69d0d8e97305) 00000020:00000080:1.0:1788930078.067645:0:14404:0:(genops.c:1384:class_connect()) connect: client 3e0889e5-a3a3-4d3e-b42f-69d0d8e97305, cookie 0xce4472dd2237d8f3 00000100:00080000:1.0:1788930078.067659:0:14404:0:(import.c:545:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788930078.067671:0:14404:0:(import.c:666:import_select_connection()) MGC192.168.204.140@tcp: import ffff8d2ebc281000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930078.067744:0:14404:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d867c1500 x1875828770167808/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788930078.067775:0:14404:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3e0889e5-a3a3-4d3e-b42f-69d0d8e97305->MGS 00000020:01000004:1.0:1788930078.067801:0:14404:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788930078.067806:0:14404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788930078.067820:0:14404:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d2ebccd19c0) 00000020:00000080:1.0:1788930078.067838:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788930078.068524:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3307:1875828770167808:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788930078.068604:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930078.068673:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770167808 00000100:00100000:3.0:1788930078.068681:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770167808 00000100:00100000:3.0:1788930078.068786:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788930078.068795:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebe0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3307:x1875828770167808:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788930078.068819:0:14416:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 3e0889e5-a3a3-4d3e-b42f-69d0d8e97305@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:3.0:1788930078.068846:0:14416:0:(genops.c:1384:class_connect()) connect: client 3e0889e5-a3a3-4d3e-b42f-69d0d8e97305, cookie 0xce4472dd2237d901 00000100:00080000:3.0:1788930078.070190:0:14416:0:(import.c:65:import_set_state_nolock()) ffff8d2ebc280800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788930078.070302:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebe0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+5:3307:x1875828770167808:12345-0@lo:250:mount.lustre.0 Request processed in 1505us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930078.070314:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788930078.072920:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788930078.072943:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.140@tcp: connect to target with instance 0 00000100:00080000:3.0:1788930078.072954:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788930078.072961:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788930078.072967:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2ebc281000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788930078.072970:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788930078.075077:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788930078.075095:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3307:1875828770167808:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788930078.097607:0:14404:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788930078.097812:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788930078.097818:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788930078.107851:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788930078.109092:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788930078.113455:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788930078.113468:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788930078.115833:0:14404:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788930078.116174:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788930078.116179:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788930078.120479:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788930078.120500:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788930078.167947:0:14404:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788930078.168158:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788930078.168165:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788930078.179535:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788930078.179551:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788930078.181643:0:14404:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788930078.181837:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788930078.181854:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788930078.184212:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788930078.193605:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788930078.194634:0:14404:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788930078.194832:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788930078.194838:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788930078.198672:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788930078.198685:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788930078.200967:0:14404:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788930078.201166:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788930078.201172:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788930078.204070:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788930078.204086:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788930078.254633:0:14404:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788930078.254955:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788930078.254962:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788930078.265918:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788930078.265938:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788930078.267608:0:14404:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788930078.267622:0:14404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788930078.276778:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788930078.276984:0:14404:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788930078.276992:0:14404:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788930078.277157:0:14404:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788930078.277213:0:14404:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.140@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788930078.277218:0:14404:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788930078.277219:0:14404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788930078.277257:0:14404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788930078.277259:0:14404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788930078.277260:0:14404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788930078.277261:0:14404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788930078.277263:0:14404:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788930078.277264:0:14404:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788930078.277265:0:14404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788930078.277267:0:14404:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788930078.277270:0:14404:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788930078.277272:0:14404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788930078.277273:0:14404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788930078.277274:0:14404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788930078.277275:0:14404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788930078.277276:0:14404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788930078.277277:0:14404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788930078.277278:0:14404:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788930078.277279:0:14404:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788930078.277280:0:14404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788930078.277281:0:14404:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788930078.277317:0:14404:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788930078.277337:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770167936:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788930078.277424:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930078.277477:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07540 going to sleep for 11 seconds 00000100:00100000:1.0:1788930078.277572:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770167936 00000100:00100000:1.0:1788930078.277579:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770167936 00000100:00100000:1.0:1788930078.277625:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788930078.277633:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+5:14404:x1875828770167936:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788930078.277684:0:14417:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788930078.277688:0:14417:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788930078.277691:0:14417:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788930078.278768:0:14438:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788930078.279362:0:14417:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788930078.288143:0:14439:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788930078.288154:0:14439:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788930078.288157:0:14439:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788930078.288187:0:14439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788930078.289111:0:14417:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788930078.289124:0:14417:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788930078.299063:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770167936:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788930078.299081:0:14404:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788930078.299084:0:14404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788930078.299086:0:14404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788930078.299087:0:14404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788930078.299089:0:14404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788930078.299090:0:14404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788930078.299091:0:14404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788930078.299092:0:14404:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788930078.299094:0:14404:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788930078.299096:0:14404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788930078.299097:0:14404:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788930078.299119:0:14404:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2ebe0db800 from lustre-MDT0000 10000000:01000000:2.0:1788930078.299150:0:14404:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788930078.299153:0:14404:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788930078.299157:0:14404:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d2eb5b88000 10000000:01000000:2.0:1788930078.299162:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788930078.299170:0:14404:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2eb5b88000 from 1 10000000:01000000:2.0:1788930078.299173:0:14404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788930078.299216:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.299260:0:14404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.299270:0:14404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930078.299299:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770168064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788930078.302944:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930078.303005:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788930078.303152:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770168064 00000100:00100000:3.0:1788930078.303162:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770168064 00000100:00100000:3.0:1788930078.303251:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788930078.303262:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5436c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+6:14404:x1875828770168064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930078.303290:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930078.303313:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d8677d800/0xce4472dd2237d90f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237d908 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930078.303339:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d8677d800/0xce4472dd2237d90f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237d908 expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930078.303351:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d8677d800/0xce4472dd2237d90f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237d908 expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930078.303360:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8677d800, rc 0) 00000100:00100000:3.0:1788930078.303418:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5436c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+7:14404:x1875828770168064:12345-0@lo:101:mount.lustre.0 Request processed in 159us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930078.303424:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788930078.303643:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+6:14404:x1875828770167936:12345-0@lo:253:mount.lustre.0 Request processed in 26010us (26218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930078.303655:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788930078.303892:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770168064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930078.303910:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d90f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.303919:0:14404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237d90f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930078.303989:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770168192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930078.304023:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930078.304055:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788930078.304157:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770168192 00000100:00100000:0.0:1788930078.304163:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770168192 00000100:00100000:0.0:1788930078.304198:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788930078.304205:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+6:14404:x1875828770168192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930078.304496:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+6:14404:x1875828770168192:12345-0@lo:501:mount.lustre.0 Request processed in 291us (471us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788930078.304503:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788930078.304831:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770168192:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788930078.304874:0:14404:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788930078.304893:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d90f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.304903:0:14404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d90f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930078.304913:0:14404:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2ebe0db800 10000000:01000000:2.0:1788930078.304919:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788930078.304923:0:14404:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d2ebe0db800 10000000:01000000:2.0:1788930078.304925:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788930078.304929:0:14404:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d2ebe0db800 from 1 10000000:01000000:2.0:1788930078.304931:0:14404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788930078.304958:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.304974:0:14404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.304984:0:14404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930078.304999:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770168320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788930078.305030:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930078.305058:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788930078.305161:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770168320 00000100:00100000:1.0:1788930078.305168:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770168320 00000100:00100000:1.0:1788930078.305194:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788930078.305202:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+6:14404:x1875828770168320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788930078.305214:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930078.305255:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237d91d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237d916 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.305289:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237d91d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237d916 expref: 7 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.305301:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237d91d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237d916 expref: 7 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.305309:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153c00, rc 0) 00000100:00100000:1.0:1788930078.305345:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+7:14404:x1875828770168320:12345-0@lo:101:mount.lustre.0 Request processed in 143us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930078.305357:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788930078.305557:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770168320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930078.305568:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.305577:0:14404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930078.305589:0:14404:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788930078.305603:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.305609:0:14404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930078.305615:0:14404:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788930078.305618:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788930078.305623:0:14404:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d2ebe0db800 10000000:01000000:2.0:1788930078.305625:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788930078.305633:0:14404:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788930078.305635:0:14404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788930078.305650:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.305657:0:14404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.305664:0:14404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930078.305676:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770168448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788930078.305700:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930078.305910:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770168448 00000100:00100000:1.0:1788930078.305915:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770168448 00000100:00100000:1.0:1788930078.305951:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788930078.305959:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+7:14404:x1875828770168448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788930078.305967:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930078.305976:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237d92b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237d924 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.305991:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237d92b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237d924 expref: 8 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.305999:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237d92b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237d924 expref: 8 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.306006:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152400, rc 0) 00000100:00100000:1.0:1788930078.306032:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+8:14404:x1875828770168448:12345-0@lo:101:mount.lustre.0 Request processed in 73us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930078.306039:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788930078.306121:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788930078.306136:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770168448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930078.306146:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.306153:0:14404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930078.306194:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770168576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930078.306220:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930078.306262:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788930078.306395:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770168576 00000100:00100000:0.0:1788930078.306410:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770168576 00000100:00100000:0.0:1788930078.306442:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788930078.306449:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+8:14404:x1875828770168576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930078.309258:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+9:14404:x1875828770168576:12345-0@lo:501:mount.lustre.0 Request processed in 2798us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930078.309274:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788930078.319321:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770168576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930078.319422:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770168704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788930078.319520:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930078.319581:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788930078.319793:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770168704 00000100:00100000:3.0:1788930078.319802:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770168704 00000100:00100000:3.0:1788930078.319866:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788930078.319875:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+9:14404:x1875828770168704:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930078.320447:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+9:14404:x1875828770168704:12345-0@lo:503:mount.lustre.0 Request processed in 570us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930078.320464:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788930078.320686:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770168704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788930078.323906:0:14440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14440:1875828770168832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788930078.323999:0:14440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930078.324045:0:14440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e8c0f5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788930078.324164:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770168832 00000100:00100000:0.0:1788930078.324174:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770168832 00000100:00100000:0.0:1788930078.324258:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788930078.324267:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+9:14440:x1875828770168832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788930078.324632:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+9:14440:x1875828770168832:12345-0@lo:502:llog_process_th.0 Request processed in 365us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930078.324981:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788930078.325152:0:14440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14440:1875828770168832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788930078.325186:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788930078.325197:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930078.325199:0:14440:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788930078.325204:0:14440:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788930078.325212:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788930078.325268:0:14440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d2ebccd0000) 00000020:00000080:1.0:1788930078.325295:0:14440:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788930078.325302:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788930078.325382:0:14440:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788930078.325389:0:14440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237d939 00000020:00000080:1.0:1788930078.325615:0:14440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788930078.325620:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788930078.325624:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930078.325625:0:14440:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788930078.325628:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788930078.325631:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930078.325632:0:14440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788930078.325636:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788930078.325643:0:14440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d2ebccd3380) 00000020:00000080:1.0:1788930078.325653:0:14440:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788930078.325657:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788930078.325659:0:14440:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788930078.325662:0:14440:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788930078.325668:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788930078.325705:0:14440:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2ebe0db800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788930078.325718:0:14440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d2ebccd4d40) 00000020:00000080:1.0:1788930078.325726:0:14440:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788930078.325789:0:14440:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788930078.325796:0:14440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237d94e 00000020:00000080:1.0:1788930078.326621:0:14440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788930078.326631:0:14440:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788930078.326640:0:14440:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xce4472dd2237d955 00080000:01000000:1.0:1788930078.326646:0:14440:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788930078.326650:0:14440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237d95c 00010000:00010000:2.0:1788930078.440148:0:14440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788930078.440664:0:14440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788930078.441408:0:14440:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788930078.441959:0:14440:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d2eb5b8b380) 00000020:00000080:3.0:1788930078.441978:0:14440:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788930078.442053:0:14440:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788930078.442062:0:14440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237d96a 00000020:00000080:1.0:1788930078.452074:0:14440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788930078.471680:0:14440:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xce4472dd2237d971 00000020:00000080:1.0:1788930078.472204:0:14440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788930078.472417:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788930078.472424:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930078.472426:0:14440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788930078.472430:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788930078.472436:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930078.472437:0:14440:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788930078.472441:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788930078.472478:0:14440:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788930078.472493:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788930078.472497:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930078.472498:0:14440:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788930078.472501:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788930078.472503:0:14440:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788930078.472504:0:14440:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788930078.472506:0:14440:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788930078.472507:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788930078.472514:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930078.472515:0:14440:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788930078.472517:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788930078.472521:0:14440:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788930078.472524:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930078.472525:0:14440:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788930078.472528:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788930078.472534:0:14440:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:1.0:1788930078.472560:0:14440:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788930078.472563:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788930078.472590:0:14440:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d2eafc9b380) 00000020:00000080:1.0:1788930078.472606:0:14440:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788930078.472612:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788930078.472664:0:14440:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788930078.472669:0:14440:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788930078.472674:0:14440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237d97f 00010000:00080000:1.0:1788930078.472703:0:14440:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2e90255000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:1.0:1788930078.475017:0:14440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788930078.482936:0:14440:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788930078.483025:0:14440:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788930078.484013:0:14440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788930078.484071:0:14440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788930078.487617:0:14440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788930078.490071:0:14444:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788930078.490079:0:14444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788930078.492151:0:14440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788930078.492169:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788930078.492206:0:14440:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788930078.492247:0:14440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237d986 00000100:00080000:1.0:1788930078.492262:0:14440:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788930078.492292:0:14440:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2e90255000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930078.492341:0:14440:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d867c2d80 x1875828770168960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788930078.492370:0:14440:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788930078.492430:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788930078.492434:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930078.492436:0:14440:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788930078.492439:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788930078.492441:0:14440:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788930078.492443:0:14440:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788930078.492445:0:14440:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788930078.492447:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788930078.492449:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930078.492451:0:14440:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788930078.492453:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788930078.492458:0:14440:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788930078.492461:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930078.492462:0:14440:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788930078.492465:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788930078.492469:0:14440:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:1.0:1788930078.492493:0:14440:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788930078.492513:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788930078.492526:0:14440:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d2eafc9cd40) 00000020:00000080:1.0:1788930078.492538:0:14440:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788930078.492544:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788930078.492602:0:14440:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788930078.492609:0:14440:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788930078.492614:0:14440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237d994 00010000:00080000:1.0:1788930078.492643:0:14440:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2e863d3800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:1.0:1788930078.492840:0:14440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788930078.493026:0:14440:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788930078.493046:0:14440:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788930078.493615:0:14440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788930078.493681:0:14440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788930078.493755:0:14440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1788930078.495214:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770168960:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788930078.495653:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875828770168960 offset 0 length 520: 4 00000040:00080000:3.0:1788930078.497359:0:14446:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788930078.497368:0:14446:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788930078.498628:0:14440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788930078.498643:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788930078.498676:0:14440:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788930078.498699:0:14440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237d99b 00000100:00080000:3.0:1788930078.498797:0:14440:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788930078.498810:0:14440:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2e863d3800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1788930078.498922:0:14440:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d85d3c700 x1875828770169088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788930078.498997:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770169088:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788930078.499056:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875828770169088 offset 0 length 520: 4 00000100:00080000:3.0:1788930078.499111:0:14440:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788930078.499169:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930078.499173:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930078.499175:0:14440:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788930078.499179:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930078.499183:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930078.499184:0:14440:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788930078.499187:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788930078.499188:0:14440:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788930078.499191:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930078.499205:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930078.499206:0:14440:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788930078.499210:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930078.499212:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930078.499213:0:14440:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788930078.499216:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788930078.499272:0:14440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14440:1875828770169216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788930078.499341:0:14440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930078.499371:0:14440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9010de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788930078.499679:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770169216 00000100:00100000:1.0:1788930078.499688:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770169216 00000100:00100000:1.0:1788930078.499748:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788930078.499760:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+9:14440:x1875828770169216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788930078.500067:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+9:14440:x1875828770169216:12345-0@lo:502:llog_process_th.0 Request processed in 308us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930078.500076:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788930078.500292:0:14440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14440:1875828770169216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788930078.500324:0:14440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788930078.500330:0:14440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788930078.500332:0:14440:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788930078.500338:0:14440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788930078.500509:0:14404:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788930078.500531:0:14404:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788930078.500552:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.500565:0:14404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930078.500573:0:14404:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2ebe0db800 from 1 10000000:01000000:2.0:1788930078.500577:0:14404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788930078.500611:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.500619:0:14404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.500628:0:14404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930078.500645:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770169344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788930078.500694:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930078.500717:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788930078.501212:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770169344 00000100:00100000:1.0:1788930078.501220:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770169344 00000100:00100000:1.0:1788930078.501293:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788930078.501301:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+9:14404:x1875828770169344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788930078.501313:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930078.501329:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237d9a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237d9a2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.501353:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237d9a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237d9a2 expref: 10 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.501374:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237d9a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237d9a2 expref: 10 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.501383:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152600, rc 0) 00000100:00100000:1.0:1788930078.501600:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+10:14404:x1875828770169344:12345-0@lo:101:mount.lustre.0 Request processed in 300us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930078.501607:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788930078.502099:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770169344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930078.502118:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d9a9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.502128:0:14404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237d9a9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930078.502739:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770169472:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788930078.502793:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930078.502824:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788930078.503039:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770169472 00000100:00100000:3.0:1788930078.503045:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770169472 00000100:00100000:3.0:1788930078.503091:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788930078.503100:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+10:14404:x1875828770169472:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788930078.503119:0:14417:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788930078.503125:0:14417:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788930078.503211:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+10:14404:x1875828770169472:12345-0@lo:256:mount.lustre.0 Request processed in 112us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930078.503219:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788930078.503339:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770169472:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788930078.504008:0:14404:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788930078.504033:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d9a9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.504044:0:14404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d9a9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930078.504141:0:14404:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2ebe0db800 from 1 10000000:01000000:3.0:1788930078.504145:0:14404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788930078.504358:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930078.504368:0:14404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930078.504380:0:14404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930078.504415:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770169600:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788930078.504600:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930078.504628:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9010de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788930078.504944:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770169600 00000100:00100000:2.0:1788930078.504951:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770169600 00000100:00100000:2.0:1788930078.504990:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788930078.504999:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+10:14404:x1875828770169600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930078.505011:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930078.505030:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5340200/0xce4472dd2237d9b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237d9b0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.505110:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5340200/0xce4472dd2237d9b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237d9b0 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.505120:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5340200/0xce4472dd2237d9b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237d9b0 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.505129:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340200, rc 0) 00000100:00100000:2.0:1788930078.505174:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:14404:x1875828770169600:12345-0@lo:101:mount.lustre.0 Request processed in 176us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930078.505180:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788930078.505352:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770169600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930078.505367:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d9b7 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930078.505375:0:14404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237d9b7 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930078.505453:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770169728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930078.505482:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930078.505969:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770169728 00000100:00100000:1.0:1788930078.505976:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770169728 00000100:00100000:1.0:1788930078.506021:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788930078.506029:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:14404:x1875828770169728:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930078.506351:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9010de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788930078.507036:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:14404:x1875828770169728:12345-0@lo:501:mount.lustre.0 Request processed in 1006us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930078.507046:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788930078.507138:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770169728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930078.507582:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770169856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930078.507633:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930078.507665:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9010de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788930078.507777:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770169856 00000100:00100000:0.0:1788930078.507784:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770169856 00000100:00100000:0.0:1788930078.507822:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788930078.507829:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5435850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:14404:x1875828770169856:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788930078.508060:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5435850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:14404:x1875828770169856:12345-0@lo:503:mount.lustre.0 Request processed in 231us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930078.508068:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788930078.508147:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770169856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930078.509385:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14448:1875828770169984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788930078.509467:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930078.509859:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9010d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788930078.509904:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770169984 00000100:00100000:2.0:1788930078.509913:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770169984 00000100:00100000:2.0:1788930078.509969:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788930078.509978:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:14448:x1875828770169984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788930078.510838:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:14448:x1875828770169984:12345-0@lo:502:llog_process_th.0 Request processed in 726us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930078.510849:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788930078.510938:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14448:1875828770169984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788930078.510976:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930078.510990:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930078.510993:0:14448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788930078.511003:0:14448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2ebe0db800 00000020:00000080:3.0:1788930078.511013:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788930078.511023:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930078.511026:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930078.511028:0:14448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788930078.511030:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930078.511033:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930078.511034:0:14448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788930078.511037:0:14448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2ebe0db800 00000020:00000080:3.0:1788930078.511039:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788930078.511133:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930078.511137:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930078.511138:0:14448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788930078.511141:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930078.511143:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930078.511144:0:14448:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788930078.511148:0:14448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2ebe0db800 00000020:00000080:3.0:1788930078.511150:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788930078.513419:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14448:1875828770170112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788930078.513565:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930078.513683:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9010d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788930078.520909:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770170112 00000100:00100000:0.0:1788930078.520925:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770170112 00000100:00100000:0.0:1788930078.520981:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788930078.520991:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:14448:x1875828770170112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788930078.521286:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:14448:x1875828770170112:12345-0@lo:502:llog_process_th.0 Request processed in 294us (7719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930078.521294:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788930078.521457:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14448:1875828770170112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788930078.521494:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788930078.521502:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930078.521505:0:14448:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788930078.521510:0:14448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788930078.522042:0:14404:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788930078.522061:0:14404:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788930078.522089:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d9b7 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.522103:0:14404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d9b7 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930078.522162:0:14404:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788930078.522166:0:14404:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2ebe0db800 10000000:01000000:2.0:1788930078.522175:0:14404:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2ebe0db800 10000000:01000000:2.0:1788930078.522179:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788930078.522186:0:14404:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2ebe0db800 from 1 10000000:01000000:2.0:1788930078.522189:0:14404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788930078.522252:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.522262:0:14404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.522273:0:14404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930078.522296:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770170240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788930078.522342:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930078.522371:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e22840 going to sleep for 11 seconds 00000100:00100000:2.0:1788930078.522390:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770170240 00000100:00100000:2.0:1788930078.522406:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770170240 00000100:00100000:2.0:1788930078.522439:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788930078.522448:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:14404:x1875828770170240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930078.522461:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930078.522476:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5340c00/0xce4472dd2237d9c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237d9be expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.522498:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5340c00/0xce4472dd2237d9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237d9be expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.522509:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5340c00/0xce4472dd2237d9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237d9be expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.522925:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340c00, rc 0) 00000100:00100000:2.0:1788930078.522976:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14404:x1875828770170240:12345-0@lo:101:mount.lustre.0 Request processed in 529us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930078.522983:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788930078.526497:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770170240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930078.526527:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930078.526541:0:14404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930078.526628:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770170368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930078.526691:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930078.526736:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9010d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788930078.530669:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770170368 00000100:00100000:0.0:1788930078.530699:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770170368 00000100:00100000:0.0:1788930078.530778:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788930078.530790:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14404:x1875828770170368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930078.532419:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14404:x1875828770170368:12345-0@lo:501:mount.lustre.0 Request processed in 1622us (5718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930078.532433:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788930078.532571:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770170368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930078.532622:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770170496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930078.532665:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930078.532702:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9010d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788930078.532748:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770170496 00000100:00100000:0.0:1788930078.532754:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770170496 00000100:00100000:0.0:1788930078.532785:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788930078.532793:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14404:x1875828770170496:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788930078.532960:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14404:x1875828770170496:12345-0@lo:503:mount.lustre.0 Request processed in 166us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930078.532967:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788930078.533093:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770170496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930078.538733:0:14452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14452:1875828770170624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788930078.542510:0:14452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930078.542567:0:14452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9010dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788930078.543187:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770170624 00000100:00100000:1.0:1788930078.543201:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770170624 00000100:00100000:1.0:1788930078.543291:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788930078.543303:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14452:x1875828770170624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788930078.543665:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14452:x1875828770170624:12345-0@lo:502:llog_process_th.0 Request processed in 364us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930078.543675:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788930078.543743:0:14452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14452:1875828770170624:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788930078.543833:0:14452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788930078.543850:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d2eafc999c0) 00000020:00000080:1.0:1788930078.543872:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788930078.543966:0:14452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2ebe0db800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788930078.543971:0:14452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2ebe0db800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788930078.543974:0:14452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2ebe0db800 4 00010000:00080000:1.0:1788930078.544018:0:14452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2e8606c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:1.0:1788930078.545677:0:14452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788930078.545933:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788930078.545973:0:14452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788930078.545989:0:14452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xce4472dd2237d9d3 00000100:00080000:1.0:1788930078.546002:0:14452:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788930078.547833:0:14452:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d2e8606c000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930078.547893:0:14452:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d867c1f80 x1875828770170752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788930078.547933:0:14452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788930078.548043:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770170752:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788930078.548136:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930078.548293:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770170752 00000100:00100000:1.0:1788930078.548302:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770170752 00000100:00100000:1.0:1788930078.548343:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788930078.548351:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875828770170752:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788930078.548431:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875828770170752:12345-0@lo:38:llog_process_th.0 Request processed in 79us (296us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788930078.548437:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788930078.548583:0:14452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14452:1875828770170880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788930078.548640:0:14452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930078.548661:0:14452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e8640ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788930078.548731:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770170880 00000100:00100000:0.0:1788930078.548737:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770170880 00000100:00100000:0.0:1788930078.548778:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788930078.548786:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14452:x1875828770170880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788930078.548894:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788930078.548904:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e8606c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788930078.548909:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788930078.548913:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770170752:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788930078.549461:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14452:x1875828770170880:12345-0@lo:502:llog_process_th.0 Request processed in 672us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930078.549469:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788930078.551892:0:14452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14452:1875828770170880:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788930078.551959:0:14452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788930078.552779:0:14404:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788930078.553018:0:14404:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788930078.553052:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.553067:0:14404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788930078.553522:0:14404:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788930078.553525:0:14404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788930078.553527:0:14404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788930078.553528:0:14404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788930078.553530:0:14404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788930078.553531:0:14404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788930078.553533:0:14404:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788930078.553535:0:14404:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788930078.553537:0:14404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788930078.553538:0:14404:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788930078.553542:0:14404:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788930078.553544:0:14404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788930078.553546:0:14404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788930078.553547:0:14404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788930078.553548:0:14404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788930078.553549:0:14404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788930078.553550:0:14404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788930078.553551:0:14404:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788930078.553552:0:14404:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788930078.553553:0:14404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788930078.553554:0:14404:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788930078.553606:0:14404:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788930078.553628:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770171008:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788930078.553706:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930078.553772:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e8640ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788930078.554003:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770171008 00000100:00100000:2.0:1788930078.554011:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770171008 00000100:00100000:2.0:1788930078.554074:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788930078.554085:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14404:x1875828770171008:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788930078.554119:0:14417:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788930078.554136:0:14417:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788930078.622134:0:14417:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788930078.622160:0:14417:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788930078.622189:0:14438:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788930078.622196:0:14438:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788930078.622250:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930078.622269:0:14438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237d9a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237d9a2 expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930078.622279:0:14438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930078.622405:0:14438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237d9a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237d9a2 expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930078.622440:0:14438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237d9a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237d9a2 expref: 12 pid: 14417 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930078.622468:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14438:1875828770171136:0@lo:104: 00000100:00100000:3.0:1788930078.622539:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930078.622580:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e902866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788930078.622763:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770171136 00000100:00100000:2.0:1788930078.622772:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770171136 00000100:00100000:2.0:1788930078.622828:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788930078.622838:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+3:14438:x1875828770171136:12345-0@lo:104: 00010000:00010000:2.0:1788930078.622852:0:14405:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237d9a9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.622913:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788930078.622919:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+3:14438:x1875828770171136:12345-0@lo:104: Request processed in 83us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930078.622926:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788930078.622970:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14438:1875828770171136:0@lo:104: 00010000:00010000:2.0:1788930078.622988:0:14438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.623085:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930078.623093:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237d9a9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.623112:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340000 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788930078.623117:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237d9a9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.623125:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237d9a9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788930078.623131:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237d9a9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788930078.623137:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788930078.623165:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237d9a9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.623171:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788930078.623191:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237d9a9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.623199:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340000/0xce4472dd2237d9a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237d9a9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930078.623217:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930078.623218:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930078.623220:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930078.623984:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770171264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788930078.624027:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930078.628371:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770171264 00000100:00100000:2.0:1788930078.628410:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770171264 00010000:00010000:2.0:1788930078.628451:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237d9a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237d9a2 expref: 13 pid: 14417 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930078.628496:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788930078.628506:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+13:3309:x1875828770171264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788930078.628523:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788930078.628528:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237d9a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237d9a2 expref: 13 pid: 14417 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.628542:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237d9a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237d9a2 expref: 13 pid: 14417 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.629834:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2152600/0xce4472dd2237d9a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237d9a2 expref: 13 pid: 14417 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.629857:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.629867:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788930078.629914:0:14407:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007718544s 00010000:00010000:2.0:1788930078.629920:0:14407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.629928:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.629935:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.629957:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.629964:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677c200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930078.629969:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.629977:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.630005:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930078.630016:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788930078.630097:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:3309:x1875828770171264:12345-0@lo:103:ldlm_bl.0 Request processed in 1593us (6069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930078.630107:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788930078.630250:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770171264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788930078.632443:0:14438:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930078.632461:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930078.632468:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d8677c200/0xce4472dd2237d9da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930078.636831:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:14404:x1875828770171008:12345-0@lo:253:mount.lustre.0 Request processed in 82737us (83114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930078.636846:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788930078.637353:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14404:1875828770171008:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788930078.637386:0:14404:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788930078.637400:0:14404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788930078.637402:0:14404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788930078.637403:0:14404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788930078.637405:0:14404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788930078.637406:0:14404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788930078.637408:0:14404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788930078.637409:0:14404:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788930078.637411:0:14404:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788930078.637412:0:14404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788930078.637414:0:14404:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788930078.637429:0:14404:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788930078.653039:0:14404:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930078.653186:0:14404:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788930078.653776:0:14404:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930078.654115:0:14404:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788930078.654498:0:14404:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930078.654636:0:14404:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788930078.655926:0:14404:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930078.656097:0:14404:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788930078.656686:0:14404:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930078.656985:0:14404:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788930078.657523:0:14404:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930078.657684:0:14404:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788930078.699057:0:14404:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788930078.699543:0:14404:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788930078.699635:0:14460:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788930078.699639:0:14460:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788930078.700100:0:14461:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788930078.700172:0:14461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788930078.703417:0:14404:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788930078.703698:0:14404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788930078.704516:0:14404:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788930078.704740:0:14404:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788930078.704925:0:14404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788930078.706098:0:14461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788930078.706166:0:14461:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788930078.706170:0:14461:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1788930078.706847:0:14404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788930078.707585:0:14404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788930078.707626:0:14404:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788930078.715834:0:14404:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788930078.736652:0:14404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788930078.806142:0:14404:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788930078.806191:0:14404:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa545c198f988 00100000:10000000:1.0:1788930078.806212:0:14404:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788930078.807348:0:14404:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788930078.807364:0:14404:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788930078.807380:0:14404:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788930078.807419:0:14404:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788930079.083452:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788930079.591285:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788930079.900280:0:14419:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788930079.900288:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2ebe0db800 from 6 10000000:01000000:0.0:1788930079.900294:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788930079.900342:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930079.900361:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930079.900384:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930079.900412:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770171392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788930079.900496:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930079.900555:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e993e5000 going to sleep for 11 seconds 00000100:00100000:1.0:1788930079.900700:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770171392 00000100:00100000:1.0:1788930079.900709:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770171392 00000100:00100000:1.0:1788930079.900779:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788930079.900789:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:14419:x1875828770171392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788930079.900803:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930079.900817:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ec2153a00/0xce4472dd2237d9e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237d9e1 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930079.900839:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ec2153a00/0xce4472dd2237d9e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237d9e1 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930079.900850:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ec2153a00/0xce4472dd2237d9e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237d9e1 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930079.900859:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2153a00, rc 0) 00000100:00100000:1.0:1788930079.900911:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14419:x1875828770171392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930079.900918:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788930079.901091:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770171392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788930079.901107:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d9e8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930079.901116:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237d9e8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930079.901185:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770171520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788930079.901220:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930079.901267:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89077b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788930079.901318:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770171520 00000100:00100000:1.0:1788930079.901323:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770171520 00000100:00100000:1.0:1788930079.901355:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788930079.901363:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14419:x1875828770171520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788930079.901386:0:14417:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788930079.901403:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788930079.901411:0:14417:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788930079.901502:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14419:x1875828770171520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930079.901509:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788930079.901680:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770171520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788930079.901738:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788930079.901747:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d9e8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930079.901755:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d9e8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930080.099302:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788930080.604024:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788930081.118657:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930082.146297:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930083.172750:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788930083.812752:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788930083.812759:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788930083.812778:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788930083.812781:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788930083.812783:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788930083.812787:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788930083.812790:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2e8606c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788930083.812807:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d2e8606c000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1788930083.812833:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d85134700 x1875828770171776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788930083.822780:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770171648:0@lo:400:kworker.0 00000100:00100000:2.0:1788930083.822865:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930083.822966:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770171776:0@lo:38:kworker.0 00000100:00100000:1.0:1788930083.823026:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770171648 00000100:00100000:1.0:1788930083.823035:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770171648 00000100:00100000:1.0:1788930083.823092:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788930083.823103:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:3310:x1875828770171648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930083.835839:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:3310:x1875828770171648:12345-0@lo:400:kworker.0 Request processed in 12724us (12959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930083.835856:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788930083.836440:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770171648:0@lo:400:kworker.0 00000100:00100000:2.0:1788930083.838317:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930083.838409:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770171776 00000100:00100000:0.0:1788930083.838422:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770171776 00000100:00100000:0.0:1788930083.838484:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788930083.838493:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875828770171776:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788930083.838525:0:14424:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:0.0:1788930083.838561:0:14424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xce4472dd2237d9ef 00000004:00100000:0.0:1788930083.838577:0:14424:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788930083.838717:0:14424:0:(import.c:65:import_set_state_nolock()) ffff8d2e9824b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788930083.838944:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875828770171776:12345-0@lo:38:kworker.0 Request processed in 449us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930083.838952:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788930083.839593:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2d85134700 x1875828770171776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788930093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788930083.839612:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788930083.839620:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788930083.839625:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788930083.839628:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e8606c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788930083.839635:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770171776:0@lo:38:kworker.0 00000001:02000400:2.0:1788930084.046401:0:14705:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788930084.188484:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930085.213379:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930086.235793:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930087.265309:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788930087.462793:0:14855:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd23f574d0 20000000:00000080:0.0:1788930087.462816:0:14855:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2eafe3b400 uarg=0000000000000000 20000000:01000000:0.0:1788930087.462859:0:14855:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788930087.462867:0:14855:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788930087.462872:0:14855:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788930087.465904:0:14856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788930087.466454:0:14855:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788930087.490196:0:14855:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788930087.497979:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930087.498008:0:14855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2eb5340200/0xce4472dd2237d9b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237d9b0 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930087.498030:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930087.498085:0:14855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2eb5340200/0xce4472dd2237d9b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237d9b0 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930087.498101:0:14855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2eb5340200/0xce4472dd2237d9b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237d9b0 expref: 11 pid: 14416 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930087.498116:0:14855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14855:1875828770171904:0@lo:104: 00000100:00100000:2.0:1788930087.498180:0:14855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930087.498263:0:14855:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788930087.498374:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770171904 00000100:00100000:3.0:1788930087.498382:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770171904 00000100:00100000:3.0:1788930087.498430:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788930087.498439:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+3:14855:x1875828770171904:12345-0@lo:104: 00010000:00010000:3.0:1788930087.498451:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237d9b7 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930087.498503:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788930087.498509:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+3:14855:x1875828770171904:12345-0@lo:104: Request processed in 71us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930087.499039:0:14855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14855:1875828770171904:0@lo:104: 00010000:00010000:2.0:1788930087.499071:0:14855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.499281:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930087.499290:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237d9b7 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.499299:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677c400 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788930087.499304:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237d9b7 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.499313:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237d9b7 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788930087.499320:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237d9b7 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930087.499326:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788930087.499378:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237d9b7 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.499384:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788930087.499404:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237d9b7 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.499411:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c400/0xce4472dd2237d9b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237d9b7 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.499428:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930087.499430:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930087.499432:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930087.499612:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788930087.499846:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3311:1875828770172032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788930087.499899:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930087.500610:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770172032 00000100:00100000:0.0:1788930087.500619:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770172032 00010000:00010000:0.0:1788930087.500668:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2eb5340200/0xce4472dd2237d9b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237d9b0 expref: 12 pid: 14416 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930087.500763:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788930087.500773:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:3311:x1875828770172032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788930087.500788:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930087.500794:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2eb5340200/0xce4472dd2237d9b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237d9b0 expref: 12 pid: 14416 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.500805:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2eb5340200/0xce4472dd2237d9b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237d9b0 expref: 12 pid: 14416 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.500821:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5340200/0xce4472dd2237d9b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237d9b0 expref: 12 pid: 14416 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.500838:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.500846:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.500862:0:14408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.500869:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.500875:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.500881:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.500896:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930087.500900:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.500907:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.500932:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930087.500943:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930087.501004:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:3311:x1875828770172032:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930087.501011:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788930087.501087:0:14855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930087.501096:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930087.501110:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5341400/0xce4472dd2237d9f6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930087.504622:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3311:1875828770172032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930088.291006:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788930088.924280:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788930088.924289:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788930088.924292:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788930088.924295:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788930088.924401:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770172160:0@lo:400:kworker.0 00000100:00100000:2.0:1788930088.924490:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930088.924557:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788930088.924565:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770172288:0@lo:400:kworker.0 00000100:00100000:2.0:1788930088.924594:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930088.924731:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770172160 00000100:00100000:0.0:1788930088.924740:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770172160 00000100:00100000:0.0:1788930088.924797:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788930088.924808:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e864eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:3308:x1875828770172160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930088.924866:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e864eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:3308:x1875828770172160:12345-0@lo:400:kworker.0 Request processed in 60us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930088.924874:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788930088.924924:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770172288 00000100:00100000:2.0:1788930088.924929:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770172288 00000100:00100000:2.0:1788930088.925118:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788930088.925126:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770172288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930088.925174:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770172288:12345-0@lo:400:kworker.0 Request processed in 48us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930088.925180:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788930088.928040:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2d84379880 x1875828770172288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788930088.929153:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770172288:0@lo:400:kworker.0 00000100:00100000:3.0:1788930088.929181:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770172160:0@lo:400:kworker.0 00000100:00100000:2.0:1788930088.993431:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788930078/real 1788930078] req@ffff8d2d85d3c700 x1875828770169088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930088 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930088.993463:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2d85d3c700 x1875828770169088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930088 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930088.993474:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788930078/real 1788930078] req@ffff8d2d867c2d80 x1875828770168960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930088 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930088.993486:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2d867c2d80 x1875828770168960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930088 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788930088.993507:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e863d3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788930088.993520:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788930088.993524:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770169088:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788930088.993530:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e90255000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788930088.993535:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788930088.993538:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770168960:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788930088.995364:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788930088.995374:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788930088.995378:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2e90255000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788930088.995386:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 463 00000100:00080000:1.0:1788930088.995393:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788930088.995408:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2e90255000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930088.995449:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d867c0380 x1875828770172416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788930088.995483:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788930088.995487:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788930088.995488:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2e863d3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788930088.995491:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 463 00000100:00080000:1.0:1788930088.995494:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788930088.995499:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2e863d3800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930088.995510:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d867c3100 x1875828770172544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788930088.996423:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770172416:0@lo:8:kworker.0 00000400:00000100:2.0:1788930088.996505:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875828770172416 offset 0 length 520: 4 00000100:00100000:2.0:1788930088.996544:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770172544:0@lo:8:kworker.0 00000400:00000100:2.0:1788930088.996563:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875828770172544 offset 0 length 520: 4 10000000:01000000:2.0:1788930089.115480:0:14419:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788930089.115507:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2ebe0db800 from 10 10000000:01000000:2.0:1788930089.115513:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788930089.115561:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930089.115574:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930089.115587:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930089.115614:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770172672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788930089.115687:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930089.115763:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788930089.115967:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770172672 00000100:00100000:1.0:1788930089.115976:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770172672 00000100:00100000:1.0:1788930089.116034:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788930089.116045:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e864e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+11:14419:x1875828770172672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788930089.116059:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930089.116074:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237da04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237d9fd expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930089.116101:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237da04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237d9fd expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930089.116112:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237da04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237d9fd expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930089.116121:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152a00, rc 0) 00000100:00100000:1.0:1788930089.116178:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e864e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14419:x1875828770172672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930089.116184:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788930089.119078:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770172672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788930089.119112:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da04 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930089.119127:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237da04 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930089.119277:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770172800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788930089.119336:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930089.119372:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788930089.119452:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770172800 00000100:00100000:0.0:1788930089.119472:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770172800 00000100:00100000:0.0:1788930089.119532:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788930089.119541:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e864ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14419:x1875828770172800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788930089.119829:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e864ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14419:x1875828770172800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930089.119837:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788930089.120300:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770172800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788930089.120340:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770172928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788930089.120384:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930089.120417:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788930089.120480:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770172928 00000100:00100000:0.0:1788930089.120486:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770172928 00000100:00100000:0.0:1788930089.120536:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788930089.120545:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e864e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14419:x1875828770172928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788930089.120713:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e864e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:14419:x1875828770172928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930089.120721:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788930089.120912:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770172928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788930089.125377:0:14916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788930089.125960:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788930089.125985:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788930089.125997:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da04 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930089.126009:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da04 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930089.309202:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930090.336162:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788930090.848261:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788930091.356077:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930092.379360:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930093.405051:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788930094.053956:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788930094.053964:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788930094.053974:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788930094.053977:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788930094.054720:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770173056:0@lo:400:kworker.0 00000100:00100000:1.0:1788930094.055046:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930094.055125:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788930094.055133:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770173184:0@lo:400:kworker.0 00000100:00100000:1.0:1788930094.055170:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930094.056041:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770173056 00000100:00100000:1.0:1788930094.056055:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770173056 00000100:00100000:1.0:1788930094.056118:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788930094.056127:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e864e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:3310:x1875828770173056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930094.056194:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e864e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:3310:x1875828770173056:12345-0@lo:400:kworker.0 Request processed in 68us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930094.056201:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788930094.062004:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770173184 00000100:00100000:1.0:1788930094.062019:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770173184 00000100:00100000:1.0:1788930094.062083:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788930094.062094:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770173184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930094.062192:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770173184:12345-0@lo:400:kworker.0 Request processed in 101us (7021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930094.062200:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788930094.062355:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2d85136300 x1875828770173184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930094.062370:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770173184:0@lo:400:kworker.0 00000100:00100000:1.0:1788930094.062383:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770173056:0@lo:400:kworker.0 00010000:00010000:3.0:1788930094.427685:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788930094.661759:0:15104:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788930094.661764:0:15104:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788930094.663174:0:15104:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2e881f6000 00000020:01000004:2.0:1788930094.663192:0:15104:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788930094.663203:0:15104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788930094.663217:0:15104:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d2e881e3380) 00000020:00000080:2.0:1788930094.663246:0:15104:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788930094.696755:0:15104:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788930094.697461:0:15104:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788930094.704145:0:15104:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788930094.704694:0:15104:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788930094.705001:0:15104:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788930094.705692:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 575: rc = 0 00100000:10000000:1.0:1788930094.705790:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 575: rc = 0 00100000:10000000:1.0:1788930094.705886:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 575: rc = 0 00100000:10000000:1.0:1788930094.706612:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 423: rc = 0 00100000:10000000:1.0:1788930094.707004:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 423: rc = 0 00100000:10000000:1.0:1788930094.709173:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 423: rc = 0 00100000:10000000:1.0:1788930094.709746:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 423: rc = 0 00100000:10000000:1.0:1788930094.710005:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 423: rc = 0 00100000:10000000:1.0:1788930094.711167:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 423: rc = 0 00000020:00000080:0.0:1788930094.712889:0:15104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788930094.712904:0:15104:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788930094.712915:0:15104:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xce4472dd2237da12 00000020:01000004:0.0:1788930094.712924:0:15104:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788930094.712956:0:15104:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.140@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788930094.712965:0:15104:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788930094.712971:0:15104:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788930094.712976:0:15104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788930094.712990:0:15104:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d2e86378000) 00000020:00000080:0.0:1788930094.713002:0:15104:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788930094.717634:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788930094.718369:0:15104:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788930094.718376:0:15104:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788930094.719984:0:15104:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788930094.719997:0:15104:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788930094.720680:0:15104:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788930094.720689:0:15104:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788930094.723844:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788930094.724264:0:15104:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788930094.724350:0:15104:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788930094.726155:0:15104:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788930094.726168:0:15104:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788930094.752540:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788930094.753177:0:15104:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788930094.753185:0:15104:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788930094.755101:0:15104:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788930094.755115:0:15104:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788930094.757043:0:15104:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788930094.757062:0:15104:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788930094.759680:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788930094.760022:0:15104:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788930094.760029:0:15104:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788930094.760962:0:15104:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788930094.760973:0:15104:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788930094.822186:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788930094.822764:0:15104:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788930094.822773:0:15104:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788930094.827073:0:15104:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788930094.827109:0:15104:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788930094.829387:0:15104:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788930094.829416:0:15104:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788930094.829423:0:15104:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788930094.854175:0:15104:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788930094.856564:0:15104:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.140@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788930094.856577:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788930094.856579:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788930094.856581:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930094.856582:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930094.856583:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930094.856585:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930094.856586:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788930094.856600:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930094.856602:0:15104:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788930094.856606:0:15104:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788930094.856608:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788930094.856610:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788930094.856611:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930094.856612:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930094.856613:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930094.856615:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930094.856616:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788930094.856617:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930094.856618:0:15104:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788930094.856655:0:15104:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788930094.856679:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770173312:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788930094.856767:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930094.857139:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9010de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788930094.862909:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770173312 00000100:00100000:3.0:1788930094.862928:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770173312 00000100:00100000:3.0:1788930094.863345:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788930094.863357:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:15104:x1875828770173312:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788930094.863405:0:14417:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788930094.863409:0:14417:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788930094.863413:0:14417:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788930094.877888:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:15104:x1875828770173312:12345-0@lo:253:mount.lustre.0 Request processed in 14522us (21109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930094.877908:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788930094.878111:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770173312:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788930094.878133:0:15104:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788930094.878156:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788930094.878158:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788930094.878159:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788930094.878161:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788930094.878162:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788930094.878164:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788930094.878166:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788930094.878168:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788930094.878169:0:15104:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788930094.878194:0:15104:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2e881f6000 from lustre-OST0000 10000000:01000000:3.0:1788930094.878217:0:15104:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788930094.878221:0:15104:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788930094.878258:0:15104:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2eb5b88000 local copy 00010000:00010000:3.0:1788930094.878268:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d90f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930094.878507:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770173440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930094.878624:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930094.878666:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89077180 going to sleep for 11 seconds 00000100:00100000:1.0:1788930094.878723:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770173440 00000100:00100000:1.0:1788930094.878730:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770173440 00000100:00100000:1.0:1788930094.878780:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788930094.878790:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:15104:x1875828770173440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788930094.878964:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:15104:x1875828770173440:12345-0@lo:501:mount.lustre.0 Request processed in 175us (340us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788930094.878972:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788930094.879006:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770173440:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788930094.879022:0:15104:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788930094.880629:0:15104:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788930094.880645:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d90f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.880659:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d90f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930094.880690:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2e881f6000 10000000:01000000:3.0:1788930094.880696:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788930094.880701:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d2eb5b88000 10000000:01000000:3.0:1788930094.880710:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788930094.880714:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d2eb5b88000 from 1 10000000:01000000:3.0:1788930094.880718:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788930094.880757:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677cc00/0xce4472dd2237da20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.880767:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2d8677cc00/0xce4472dd2237da20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.880856:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2d8677cc00/0xce4472dd2237da20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930094.880883:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770173568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788930094.880945:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930094.881000:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89077180 going to sleep for 11 seconds 00000100:00100000:0.0:1788930094.881276:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770173568 00000100:00100000:0.0:1788930094.881283:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770173568 00000100:00100000:0.0:1788930094.881333:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788930094.881344:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+12:15104:x1875828770173568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788930094.881356:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930094.881378:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b9200/0xce4472dd2237da27 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237da20 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930094.881403:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b9200/0xce4472dd2237da27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237da20 expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930094.881415:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebe0b9200/0xce4472dd2237da27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237da20 expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930094.881438:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9200, rc 0) 00000100:00100000:0.0:1788930094.881491:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+13:15104:x1875828770173568:12345-0@lo:101:mount.lustre.0 Request processed in 149us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930094.881498:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788930094.881708:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770173568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930094.881725:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2d8677cc00/0xce4472dd2237da20 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da27 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.881734:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2d8677cc00/0xce4472dd2237da20 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237da27 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930094.881759:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788930094.881784:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677cc00/0xce4472dd2237da20 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da27 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.881792:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2d8677cc00/0xce4472dd2237da20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da27 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930094.881799:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788930094.881808:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788930094.881813:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788930094.881816:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788930094.881836:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.881843:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.881850:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930094.881865:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770173696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788930094.881895:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930094.881932:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89077180 going to sleep for 11 seconds 00000100:00100000:1.0:1788930094.882072:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770173696 00000100:00100000:1.0:1788930094.882077:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770173696 00000100:00100000:1.0:1788930094.882122:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788930094.882130:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+13:15104:x1875828770173696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788930094.882148:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930094.882159:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ec2152e00/0xce4472dd2237da35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237da2e expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930094.882175:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ec2152e00/0xce4472dd2237da35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237da2e expref: 14 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930094.882184:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ec2152e00/0xce4472dd2237da35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237da2e expref: 14 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930094.882190:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ec2152e00, rc 0) 00000100:00100000:1.0:1788930094.882256:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+14:15104:x1875828770173696:12345-0@lo:101:mount.lustre.0 Request processed in 127us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930094.882263:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788930094.882336:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770173696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930094.882347:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930094.882356:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788930094.883169:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788930094.884755:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788930094.885060:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788930094.885138:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788930094.885168:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788930094.885214:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788930094.885292:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788930094.885330:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788930094.885396:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788930094.885404:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788930094.885497:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770173824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930094.885568:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930094.885623:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d81085a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788930094.889848:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770173824 00000100:00100000:3.0:1788930094.889865:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770173824 00000100:00100000:3.0:1788930094.889942:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788930094.889954:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+14:15104:x1875828770173824:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930094.890514:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+14:15104:x1875828770173824:12345-0@lo:501:mount.lustre.0 Request processed in 561us (4945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930094.890524:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788930094.891352:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770173824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930094.891414:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770173952:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788930094.891477:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930094.891518:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d81085a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788930094.891581:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770173952 00000100:00100000:3.0:1788930094.891587:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770173952 00000100:00100000:3.0:1788930094.892036:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788930094.892047:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+14:15104:x1875828770173952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930094.892485:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+14:15104:x1875828770173952:12345-0@lo:503:mount.lustre.0 Request processed in 439us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930094.892504:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788930094.892798:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770173952:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788930094.893892:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788930094.893992:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930094.894065:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930094.894131:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311600 going to sleep for 11 seconds 00000100:00100000:2.0:1788930094.894612:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770174080 00000100:00100000:2.0:1788930094.894622:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770174080 00000100:00100000:2.0:1788930094.894675:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788930094.894684:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+14:15104:x1875828770174080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788930094.894963:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+14:15104:x1875828770174080:12345-0@lo:502:mount.lustre.0 Request processed in 278us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930094.894970:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788930094.895702:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930094.896020:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788930094.896103:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788930094.896144:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788930094.896199:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788930094.896279:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788930094.896314:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788930094.896365:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788930094.896401:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788930094.896436:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788930094.896488:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788930094.896526:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788930094.896592:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788930094.896639:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930094.896705:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930094.896745:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311600 going to sleep for 11 seconds 00000100:00100000:2.0:1788930094.897622:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770174208 00000100:00100000:2.0:1788930094.897633:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770174208 00000100:00100000:2.0:1788930094.897691:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788930094.897701:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+14:15104:x1875828770174208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788930094.897934:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+14:15104:x1875828770174208:12345-0@lo:502:mount.lustre.0 Request processed in 233us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930094.897952:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788930094.898366:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930094.898488:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788930094.898503:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788930094.899734:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788930094.899744:0:15118:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788930094.899752:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930094.899755:0:15118:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788930094.899762:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788930094.899777:0:15118:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d2e91628000) 00000020:00000080:3.0:1788930094.899799:0:15118:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788930094.899805:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788930094.899864:0:15118:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2e881f6000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788930094.899871:0:15118:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788930094.900013:0:15118:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xce4472dd2237da43 00010000:00010000:3.0:1788930094.912863:0:15118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788930094.913617:0:15118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788930094.916694:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788930094.920112:0:15118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788930094.920126:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930094.920133:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930094.920135:0:15118:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788930094.920140:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788930094.920143:0:15118:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788930094.920145:0:15118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788930094.920147:0:15118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788930094.920148:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788930094.920150:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930094.920152:0:15118:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788930094.920155:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930094.920157:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930094.920159:0:15118:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788930094.920161:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788930094.920164:0:15118:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788930094.920166:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930094.920175:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930094.920177:0:15118:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788930094.920180:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930094.920183:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930094.920184:0:15118:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788930094.920187:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788930094.920286:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930094.920290:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930094.920291:0:15118:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788930094.920296:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788930094.920746:0:15104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788930094.920851:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788930094.920905:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930094.920919:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930094.920927:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2e881f6000 from 1 10000000:01000000:0.0:1788930094.920929:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788930094.920967:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930094.920976:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930094.920989:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930094.921017:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174336:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788930094.921117:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930094.921162:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311600 going to sleep for 11 seconds 00000100:00100000:3.0:1788930094.921304:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770174336 00000100:00100000:3.0:1788930094.921313:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770174336 00000100:00100000:3.0:1788930094.921352:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788930094.921362:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb33adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+14:15104:x1875828770174336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930094.921379:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930094.921393:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d8677da00/0xce4472dd2237da51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237da4a expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.921420:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d8677da00/0xce4472dd2237da51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237da4a expref: 15 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.921430:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d8677da00/0xce4472dd2237da51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237da4a expref: 15 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.921439:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8677da00, rc 0) 00000100:00100000:3.0:1788930094.921484:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb33adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:15104:x1875828770174336:12345-0@lo:101:mount.lustre.0 Request processed in 123us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930094.921490:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788930094.921597:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788930094.921612:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da51 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930094.921621:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237da51 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788930094.922402:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788930094.925027:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788930094.928218:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788930094.928327:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788930094.928399:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788930094.928406:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788930094.928523:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930094.930743:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930094.931058:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770174464 00000100:00100000:3.0:1788930094.931079:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770174464 00000100:00100000:3.0:1788930094.931142:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788930094.931159:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb33ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:15104:x1875828770174464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930094.931891:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb33ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:15104:x1875828770174464:12345-0@lo:501:mount.lustre.0 Request processed in 729us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930094.931902:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788930094.932153:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311600 going to sleep for 11 seconds 00000100:00100000:0.0:1788930094.932182:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930094.932305:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788930094.932354:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930094.932373:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311600 going to sleep for 11 seconds 00000100:00100000:3.0:1788930094.932897:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770174592 00000100:00100000:3.0:1788930094.932905:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770174592 00000100:00100000:3.0:1788930094.932946:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788930094.932957:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb33ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:15104:x1875828770174592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930094.933448:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb33ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:15104:x1875828770174592:12345-0@lo:503:mount.lustre.0 Request processed in 490us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930094.933457:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788930094.933898:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174592:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788930094.936208:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788930094.936334:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930094.936420:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930094.936461:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311600 going to sleep for 11 seconds 00000100:00100000:3.0:1788930094.936618:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770174720 00000100:00100000:3.0:1788930094.936627:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770174720 00000100:00100000:3.0:1788930094.936680:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788930094.936689:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:15104:x1875828770174720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788930094.937102:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:15104:x1875828770174720:12345-0@lo:502:mount.lustre.0 Request processed in 413us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930094.937112:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788930094.937211:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930094.938625:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788930094.938995:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788930094.939133:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788930094.939177:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788930094.939495:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788930094.939566:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788930094.939613:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788930094.939643:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788930094.939702:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930094.939801:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930094.939847:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311600 going to sleep for 11 seconds 00000100:00100000:3.0:1788930094.942719:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770174848 00000100:00100000:3.0:1788930094.942732:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770174848 00000100:00100000:3.0:1788930094.942794:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788930094.942804:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:15104:x1875828770174848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788930094.943082:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:15104:x1875828770174848:12345-0@lo:502:mount.lustre.0 Request processed in 277us (3279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930094.943098:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788930094.943807:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788930094.943979:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788930094.943994:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788930094.945798:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788930094.945811:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930094.945813:0:15122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788930094.945822:0:15122:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2e881f6000 00000020:00000080:0.0:1788930094.945825:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788930094.945832:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788930094.945835:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930094.945837:0:15122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788930094.945839:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788930094.945842:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930094.945843:0:15122:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788930094.945847:0:15122:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2e881f6000 00000020:00000080:0.0:1788930094.945849:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788930094.945942:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788930094.945947:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930094.945948:0:15122:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788930094.945951:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788930094.945954:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930094.945955:0:15122:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788930094.945958:0:15122:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2e881f6000 00000020:00000080:0.0:1788930094.945960:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788930094.946673:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788930094.946679:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930094.946680:0:15122:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788930094.946684:0:15122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788930094.954666:0:15104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788930094.954720:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788930094.954742:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da51 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.954755:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da51 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930094.954858:0:15104:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788930094.954861:0:15104:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2e881f6000 10000000:01000000:3.0:1788930094.954864:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2e881f6000 10000000:01000000:3.0:1788930094.954868:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788930094.954874:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2e881f6000 from 1 10000000:01000000:3.0:1788930094.954876:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788930094.954911:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.954920:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.954932:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930094.954959:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174976:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788930094.955032:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930094.955069:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770174976 00000100:00100000:3.0:1788930094.955076:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770174976 00000100:00100000:3.0:1788930094.955126:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788930094.955135:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:15104:x1875828770174976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930094.955148:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930094.955160:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d8677c600/0xce4472dd2237da5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237da58 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.955203:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d8677c600/0xce4472dd2237da5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237da58 expref: 16 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.955215:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d8677c600/0xce4472dd2237da5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237da58 expref: 16 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.955241:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8677c600, rc 0) 00000100:00100000:3.0:1788930094.955277:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15104:x1875828770174976:12345-0@lo:101:mount.lustre.0 Request processed in 143us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930094.955284:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788930094.955330:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89077240 going to sleep for 11 seconds 00000100:00100000:3.0:1788930094.955354:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770174976:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930094.955370:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930094.955379:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788930094.956011:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788930094.956528:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788930094.956805:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788930094.956851:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788930094.956903:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788930094.956953:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788930094.956992:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788930094.957041:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788930094.957074:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788930094.957120:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788930094.957183:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788930094.957218:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788930094.957284:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788930094.957337:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788930094.957369:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788930094.957401:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788930094.957443:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788930094.965546:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788930094.965612:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788930094.965697:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788930094.967996:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788930094.968056:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788930094.968155:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788930094.968196:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788930094.968250:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788930094.968304:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788930094.968340:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788930094.968375:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788930094.968441:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788930094.968481:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788930094.968914:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788930094.968925:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788930094.969050:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770175104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930094.969135:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930094.969195:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89077240 going to sleep for 11 seconds 00000100:00100000:3.0:1788930094.969281:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770175104 00000100:00100000:3.0:1788930094.969289:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770175104 00000100:00100000:3.0:1788930094.969333:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788930094.969341:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15104:x1875828770175104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930094.971943:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15104:x1875828770175104:12345-0@lo:501:mount.lustre.0 Request processed in 2591us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930094.971969:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788930094.972376:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770175104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930094.972441:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770175232:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788930094.972495:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930094.972632:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770175232 00000100:00100000:3.0:1788930094.972640:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770175232 00000100:00100000:3.0:1788930094.972680:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788930094.972688:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15104:x1875828770175232:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788930094.972847:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788930094.973879:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15104:x1875828770175232:12345-0@lo:503:mount.lustre.0 Request processed in 1188us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930094.973890:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788930094.974051:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770175232:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788930094.974964:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788930094.975049:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770175360:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930094.975119:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930094.975150:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788930094.975365:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770175360 00000100:00100000:3.0:1788930094.975372:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770175360 00000100:00100000:3.0:1788930094.975410:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788930094.975418:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15104:x1875828770175360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788930094.975689:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15104:x1875828770175360:12345-0@lo:502:mount.lustre.0 Request processed in 271us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930094.975697:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788930094.977685:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770175360:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788930094.978038:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788930094.978114:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788930094.978150:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788930094.978196:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788930094.978254:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788930094.978307:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788930094.978343:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788930094.978378:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788930094.978434:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788930094.978471:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788930094.978500:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788930094.980745:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788930094.980910:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788930094.980971:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788930094.981024:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788930094.981075:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788930094.981122:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788930094.981164:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788930094.981193:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788930094.981244:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788930094.981294:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788930094.981329:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788930094.981360:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788930094.981403:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788930094.981436:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788930094.981466:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788930094.981507:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788930094.983917:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788930094.984007:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788930094.984143:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788930094.984185:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788930094.984221:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788930094.984277:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788930094.984327:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788930094.984361:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788930094.984398:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788930094.984429:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788930094.984460:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788930094.984519:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788930094.985434:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788930094.985504:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770175488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788930094.986362:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930094.987255:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e915e8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788930094.989800:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770175488 00000100:00100000:0.0:1788930094.989817:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770175488 00000100:00100000:0.0:1788930094.989879:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788930094.989891:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15104:x1875828770175488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930094.991009:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15104:x1875828770175488:12345-0@lo:502:mount.lustre.0 Request processed in 1111us (4639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930094.991023:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788930094.991165:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770175488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788930094.991363:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788930094.991380:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788930094.993205:0:15127:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788930094.993965:0:15127:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d2e881e4d40) 00000020:00000080:2.0:1788930094.993993:0:15127:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788930094.994101:0:15127:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2e881f6000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788930094.994106:0:15127:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2e881f6000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788930094.994109:0:15127:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2e881f6000 3 00010000:00080000:2.0:1788930094.994142:0:15127:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2e83ce1000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.140@tcp at head 00010000:00010000:3.0:1788930095.003477:0:15127:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788930095.003714:0:15127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788930095.004018:0:15127:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788930095.004033:0:15127:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xce4472dd2237da6d 00000100:00080000:3.0:1788930095.004045:0:15127:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788930095.004058:0:15127:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d2e83ce1000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1788930095.004111:0:15127:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d85d3f800 x1875828770175616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788930095.004132:0:15127:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788930095.004167:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788930095.004179:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788930095.004182:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788930095.004185:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788930095.004258:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770175744:0@lo:400:kworker.0 00000100:00100000:3.0:1788930095.004320:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930095.005389:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875828770175616:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788930095.005435:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930095.005490:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770175744 00000100:00100000:2.0:1788930095.005498:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770175744 00000100:00100000:2.0:1788930095.005669:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770175616 00000100:00100000:2.0:1788930095.005674:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770175616 00000100:00100000:2.0:1788930095.005690:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788930095.005699:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770175744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930095.006017:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770175744:12345-0@lo:400:kworker.0 Request processed in 318us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930095.006025:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788930095.006044:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788930095.006058:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875828770175616:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788930095.006093:0:14423:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:2.0:1788930095.006133:0:14423:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xce4472dd2237da74 00000004:00100000:2.0:1788930095.006147:0:14423:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788930095.006180:0:14423:0:(import.c:65:import_set_state_nolock()) ffff8d2e83ce5800 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1788930095.006588:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788930095.006732:0:15104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:2.0:1788930095.007161:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875828770175616:12345-0@lo:38:llog_process_th.0 Request processed in 1098us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930095.007172:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:3.0:1788930095.007296:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788930095.010141:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930095.010160:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788930095.010264:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788930095.010267:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788930095.010268:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788930095.010269:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788930095.010271:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788930095.010272:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788930095.010273:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788930095.010275:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788930095.010276:0:15104:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788930095.010280:0:15104:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788930095.010283:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788930095.010284:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788930095.010285:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788930095.010286:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788930095.010287:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788930095.010289:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788930095.010290:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788930095.010291:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788930095.010299:0:15104:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788930095.010329:0:15104:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788930095.010351:0:15104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770175872:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788930095.010449:0:15104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930095.010496:0:15104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87e7e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788930095.010827:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770175872 00000100:00100000:0.0:1788930095.010837:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770175872 00000100:00100000:0.0:1788930095.010909:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788930095.010919:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15104:x1875828770175872:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788930095.010950:0:14417:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788930095.010966:0:14417:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788930095.012161:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2d85d3f800 x1875828770175616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788930105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930095.012176:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788930095.012197:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788930095.012207:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788930095.012213:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788930095.012217:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e83ce1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788930095.012261:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875828770175616:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788930095.012346:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2d85d3d880 x1875828770175744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930095.012356:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770175744:0@lo:400:kworker.0 20000000:01000000:0.0:1788930095.053169:0:14417:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788930095.053182:0:14417:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788930095.053414:0:14438:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788930095.053419:0:14438:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788930095.053444:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930095.053464:0:14438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ec2153a00/0xce4472dd2237d9e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237d9e1 expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930095.053473:0:14438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930095.053517:0:14438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ec2153a00/0xce4472dd2237d9e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237d9e1 expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930095.053701:0:14438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ec2153a00/0xce4472dd2237d9e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237d9e1 expref: 16 pid: 14416 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930095.053719:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14438:1875828770176000:0@lo:104: 00000100:00100000:3.0:1788930095.054573:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930095.054626:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9acfd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788930095.055034:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770176000 00000100:00100000:0.0:1788930095.055044:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770176000 00000100:00100000:0.0:1788930095.055103:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788930095.055113:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+3:14438:x1875828770176000:12345-0@lo:104: 00010000:00010000:0.0:1788930095.055129:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237d9e8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930095.055308:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14438:1875828770176000:0@lo:104: 00010000:00010000:3.0:1788930095.055336:0:14438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930095.056512:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788930095.056526:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+3:14438:x1875828770176000:12345-0@lo:104: Request processed in 1411us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930095.056546:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788930095.064382:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930095.064402:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237d9e8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.064442:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8c00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788930095.064447:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237d9e8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.064459:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237d9e8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788930095.064467:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237d9e8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788930095.064473:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788930095.064551:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237d9e8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.064558:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788930095.064585:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237d9e8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.064591:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237d9e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237d9e8 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.064611:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930095.064613:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930095.064614:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930095.064639:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770176128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788930095.064724:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930095.065103:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770176128 00000100:00100000:1.0:1788930095.065111:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770176128 00010000:00010000:1.0:1788930095.065137:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ec2153a00/0xce4472dd2237d9e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237d9e1 expref: 17 pid: 14416 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930095.065186:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788930095.065205:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:3309:x1875828770176128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930095.065219:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930095.065248:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ec2153a00/0xce4472dd2237d9e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237d9e1 expref: 17 pid: 14416 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.065259:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ec2153a00/0xce4472dd2237d9e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237d9e1 expref: 17 pid: 14416 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.065274:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2153a00/0xce4472dd2237d9e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237d9e1 expref: 17 pid: 14416 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.065290:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.065298:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788930095.065313:0:14407:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011894364s 00010000:00010000:1.0:1788930095.065317:0:14407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.065325:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.065332:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.065339:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.065353:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677ca00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930095.065358:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.065366:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.065382:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.065392:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930095.065430:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:3309:x1875828770176128:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930095.065439:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788930095.065477:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770176128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930095.065498:0:14438:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.065507:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930095.065513:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237da7b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930095.070580:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:15104:x1875828770175872:12345-0@lo:253:mount.lustre.0 Request processed in 59652us (60121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930095.070617:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788930095.070903:0:15104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15104:1875828770175872:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788930095.070921:0:15104:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788930095.070924:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788930095.070936:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788930095.070937:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930095.070939:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930095.070940:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930095.070941:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930095.070943:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788930095.070944:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930095.070946:0:15104:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788930095.070965:0:15104:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788930095.079048:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930095.079290:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788930095.079477:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930095.079893:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788930095.080154:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930095.081182:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788930095.088827:0:15104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788930095.195654:0:15104:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788930095.195666:0:15104:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788930095.195714:0:15104:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788930095.196049:0:15104:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788930095.196076:0:15104:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788930095.196120:0:15104:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788930095.460213:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930096.476475:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788930096.859345:0:14419:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788930096.859354:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2ebe0db800 from 7 10000000:01000000:3.0:1788930096.859359:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788930096.859409:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930096.859422:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930096.859433:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930096.859459:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770176256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788930096.859540:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930096.859593:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311780 going to sleep for 11 seconds 00000100:00100000:2.0:1788930096.859737:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770176256 00000100:00100000:2.0:1788930096.859759:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770176256 00000100:00100000:2.0:1788930096.859806:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788930096.859815:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:14419:x1875828770176256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788930096.859829:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930096.859841:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5341e00/0xce4472dd2237da89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237da82 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930096.859866:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5341e00/0xce4472dd2237da89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237da82 expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930096.859876:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5341e00/0xce4472dd2237da89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237da82 expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930096.859886:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341e00, rc 0) 00000100:00100000:2.0:1788930096.859946:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:14419:x1875828770176256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930096.859953:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788930096.860259:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770176256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788930096.860276:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da89 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930096.860285:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237da89 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930096.860344:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770176384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788930096.860378:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930096.860409:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e915e8000 going to sleep for 11 seconds 00000100:00100000:2.0:1788930096.860418:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770176384 00000100:00100000:2.0:1788930096.860422:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770176384 00000100:00100000:2.0:1788930096.860453:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788930096.860460:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:14419:x1875828770176384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788930096.860473:0:14417:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788930096.860491:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788930096.860494:0:14417:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788930096.860578:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:14419:x1875828770176384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930096.860586:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788930096.860649:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770176384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788930096.860704:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788930096.860712:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da89 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930096.860719:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da89 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930097.508467:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930098.526860:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930099.547369:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788930100.064708:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1788930100.188306:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788930100.188314:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788930100.188316:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788930100.188320:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788930100.188374:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770176640:0@lo:400:kworker.0 00000100:00100000:3.0:1788930100.188447:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930100.188506:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788930100.188514:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3311:1875828770176512:0@lo:400:kworker.0 00000100:00100000:3.0:1788930100.188560:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930100.188603:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770176640 00000100:00100000:3.0:1788930100.188611:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770176640 00000100:00100000:0.0:1788930100.188853:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770176768:0@lo:400:kworker.0 00000100:00100000:0.0:1788930100.188892:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930100.189059:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770176768 00000100:00100000:2.0:1788930100.189064:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770176768 00000100:00100000:2.0:1788930100.189117:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788930100.189126:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770176640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930100.189184:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770176640:12345-0@lo:400:kworker.0 Request processed in 59us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930100.189191:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788930100.189209:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788930100.189216:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770176768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930100.189268:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770176768:12345-0@lo:400:kworker.0 Request processed in 52us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930100.189274:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788930100.189309:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d85d3c000 x1875828770176768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930100.189324:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770176768:0@lo:400:kworker.0 00000100:00100000:1.0:1788930100.196827:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770176512 00000100:00100000:1.0:1788930100.196843:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770176512 00000100:00100000:1.0:1788930100.196902:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788930100.196912:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:3311:x1875828770176512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930100.197038:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:3311:x1875828770176512:12345-0@lo:400:kworker.0 Request processed in 127us (8477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930100.197057:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788930100.197127:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930100.198831:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3311:1875828770176512:0@lo:400:kworker.0 00010000:00080000:3.0:1788930100.198852:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d85d3c380 x1875828770176640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788930100.198864:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770176640:0@lo:400:kworker.0 00010000:00010000:1.0:1788930100.589990:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930101.598530:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930102.621328:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788930102.961148:0:15472:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788930103.195343:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788930088/real 1788930088] req@ffff8d2d867c0380 x1875828770172416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930103 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930103.195390:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2d867c0380 x1875828770172416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930103 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930103.195402:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788930088/real 1788930088] req@ffff8d2d867c3100 x1875828770172544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930103 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930103.195416:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2d867c3100 x1875828770172544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930103 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788930103.195447:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e90255000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788930103.195476:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788930103.195481:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770172416:0@lo:8:kworker.0 00000100:00080000:2.0:1788930103.195496:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e863d3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788930103.195504:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788930103.195507:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770172544:0@lo:8:kworker.0 00000100:00080000:0.0:1788930103.195723:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788930103.195727:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788930103.195731:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2e90255000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788930103.195736:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:0.0:1788930103.195742:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788930103.195754:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2e90255000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1788930103.195774:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d84379880 x1875828770177024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788930103.195786:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788930103.195795:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788930103.195797:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2e863d3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788930103.195800:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:0.0:1788930103.195809:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788930103.195815:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2e863d3800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1788930103.195832:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d84378a80 x1875828770177152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788930103.195885:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770177280:0@lo:400:kworker.0 00000100:00100000:0.0:1788930103.195962:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930103.196012:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788930103.196018:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770177408:0@lo:400:kworker.0 00000100:00100000:0.0:1788930103.196042:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930103.196076:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770177280 00000100:00100000:0.0:1788930103.196083:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770177280 00000100:00100000:0.0:1788930103.196126:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770177408 00000100:00100000:0.0:1788930103.196130:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770177408 00000100:00100000:0.0:1788930103.196158:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788930103.196167:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770177280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930103.196217:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770177280:12345-0@lo:400:kworker.0 Request processed in 51us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930103.196243:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788930103.196261:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788930103.196268:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770177408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930103.196298:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770177408:12345-0@lo:400:kworker.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930103.196304:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788930103.196350:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d8437aa00 x1875828770177408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930103.196363:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770177408:0@lo:400:kworker.0 00000100:00100000:1.0:1788930103.196578:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770176896:0@lo:400:kworker.0 00000100:00100000:1.0:1788930103.196618:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788930103.196654:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788930103.196692:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d84378e00 x1875828770177280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930103.196706:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770177280:0@lo:400:kworker.0 00000100:00100000:2.0:1788930103.196791:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770176896 00000100:00100000:2.0:1788930103.196796:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770176896 00000100:00100000:2.0:1788930103.196843:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788930103.196850:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:3309:x1875828770176896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930103.196901:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:3309:x1875828770176896:12345-0@lo:400:kworker.0 Request processed in 52us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930103.196907:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788930103.196954:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770177024:0@lo:8:kworker.0 00000100:00100000:2.0:1788930103.196983:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930103.197005:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770177152:0@lo:8:kworker.0 00000100:00100000:2.0:1788930103.197025:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930103.197258:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770177024 00000100:00100000:1.0:1788930103.197263:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770177024 00000100:00100000:1.0:1788930103.197281:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770177152 00000100:00100000:1.0:1788930103.197284:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770177152 00000100:00100000:1.0:1788930103.197295:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788930103.197300:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875828770177024:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788930103.197327:0:15107:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:1.0:1788930103.197363:0:15107:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237da90 00002000:00100000:1.0:1788930103.197449:0:15107:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d2ebcc55000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788930103.197454:0:15107:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788930103.197456:0:15107:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788930103.197818:0:15107:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788930103.197843:0:15107:0:(import.c:65:import_set_state_nolock()) ffff8d2e98692800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788930103.197894:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875828770177024:12345-0@lo:8:kworker.0 Request processed in 592us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930103.197901:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788930103.197921:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788930103.197925:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875828770177152:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788930103.197947:0:15107:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788930103.197985:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875828770177152:12345-0@lo:8:kworker.0 Request processed in 58us (958us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788930103.197991:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788930103.198130:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770176896:0@lo:400:kworker.0 00010000:00080000:2.0:1788930103.198215:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d84379880 x1875828770177024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788930123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930103.198256:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788930103.198263:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788930103.198272:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788930103.198276:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788930103.198279:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e90255000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788930103.198292:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788930103.198296:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770177024:0@lo:8:kworker.0 00000100:00080000:2.0:1788930103.198307:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e863d3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788930103.198310:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788930103.198320:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770177152:0@lo:8:kworker.0 00000004:00080000:0.0:1788930103.198484:0:14445:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788930103.198504:0:14445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14445:1875828770177664:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788930103.198544:0:14445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930103.198561:0:14445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1788930103.198579:0:14444:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788930103.198820:0:14444:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 488354595349ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788930103.198858:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788930103.198868:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770177536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788930103.198896:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930103.199712:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770177664 00000100:00100000:1.0:1788930103.199722:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770177664 00000100:00100000:1.0:1788930103.199775:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788930103.199783:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14445:x1875828770177664:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788930103.201741:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770177536 00000100:00100000:3.0:1788930103.201756:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770177536 00000100:00100000:3.0:1788930103.201800:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788930103.201809:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875828770177536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788930103.201842:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788930103.201924:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875828770177536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (3026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930103.201941:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788930103.201998:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d84378000 x1875828770177536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788930119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788930103.202021:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770177536:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788930103.205520:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788930103.216802:0:15107:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788930103.216812:0:15107:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788930103.216816:0:15107:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1788930103.230592:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.230607:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237da97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.230628:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.230633:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.230641:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237da97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.230661:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237da97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.230673:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237da97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.230681:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237da97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.230709:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930103.230723:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930103.230728:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237da97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.230737:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930103.230743:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237da97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.230752:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237da97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.230770:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237da97 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.230778:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237da97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.230798:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.230800:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.230802:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.231338:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.231345:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237da9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.231354:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.231363:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.231368:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237da9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.231378:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237da9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.231386:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237da9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.231393:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237da9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.231408:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930103.231418:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930103.231422:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237da9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.231429:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930103.231432:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237da9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.231439:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237da9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.231451:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237da9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.231469:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237da9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.231483:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.231485:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.231487:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.231889:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.231896:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237daa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.231904:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.231907:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.231912:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237daa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.231921:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237daa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.235096:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237daa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.235122:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237daa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.235144:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788930103.235831:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.235845:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d0ba846/0xce4472dd2237daac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.235860:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.235865:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.235872:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d0ba846/0xce4472dd2237daac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.235887:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d0ba846/0xce4472dd2237daac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.235897:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d0ba846/0xce4472dd2237daac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.235904:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d0ba846/0xce4472dd2237daac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.235925:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788930103.235955:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930103.235961:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237daa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.235969:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930103.235973:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237daa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.235983:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237daa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.236006:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237daa5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.236013:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237daa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.236034:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930103.236037:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d0ba846/0xce4472dd2237daac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.236043:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930103.236046:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d0ba846/0xce4472dd2237daac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.236052:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d0ba846/0xce4472dd2237daac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.236061:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d0ba846/0xce4472dd2237daac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.236067:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d0ba846/0xce4472dd2237daac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.236078:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.236079:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.236086:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930103.237253:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.239679:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.239696:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f974345/0xce4472dd2237dab3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.239717:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.239722:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.239729:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f974345/0xce4472dd2237dab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.239744:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f974345/0xce4472dd2237dab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.239755:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f974345/0xce4472dd2237dab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.239763:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f974345/0xce4472dd2237dab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.239790:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788930103.240289:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.240296:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065623583/0xce4472dd2237daba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.240304:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.240307:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.240311:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065623583/0xce4472dd2237daba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.240332:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065623583/0xce4472dd2237daba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.240341:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065623583/0xce4472dd2237daba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.240349:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065623583/0xce4472dd2237daba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.240364:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788930103.240510:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788930103.240518:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f974345/0xce4472dd2237dab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.240527:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930103.240532:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f974345/0xce4472dd2237dab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.240542:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f974345/0xce4472dd2237dab3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.240564:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f974345/0xce4472dd2237dab3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.240571:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f974345/0xce4472dd2237dab3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.240593:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930103.240596:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065623583/0xce4472dd2237daba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.240602:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930103.240606:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065623583/0xce4472dd2237daba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.240624:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065623583/0xce4472dd2237daba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.240635:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065623583/0xce4472dd2237daba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.240641:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065623583/0xce4472dd2237daba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.240654:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930103.240656:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930103.240658:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.241250:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788930103.241973:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788930103.243276:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.243287:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c90c8131/0xce4472dd2237dac1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.243304:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.243309:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.243315:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c90c8131/0xce4472dd2237dac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.243329:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c90c8131/0xce4472dd2237dac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.243339:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c90c8131/0xce4472dd2237dac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.243359:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c90c8131/0xce4472dd2237dac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.243448:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930103.244019:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930103.244028:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c90c8131/0xce4472dd2237dac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.244037:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930103.244042:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90c8131/0xce4472dd2237dac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.244052:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c90c8131/0xce4472dd2237dac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.244070:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c90c8131/0xce4472dd2237dac1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.244089:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c90c8131/0xce4472dd2237dac1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930103.244111:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930103.244113:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930103.244114:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.244313:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.244320:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc01b7d0/0xce4472dd2237dac8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.244329:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.244333:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.244337:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc01b7d0/0xce4472dd2237dac8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.244349:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc01b7d0/0xce4472dd2237dac8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.244359:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc01b7d0/0xce4472dd2237dac8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.244367:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc01b7d0/0xce4472dd2237dac8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.245489:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788930103.245944:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930103.245954:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc01b7d0/0xce4472dd2237dac8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.245966:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930103.245970:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc01b7d0/0xce4472dd2237dac8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.245994:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc01b7d0/0xce4472dd2237dac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.246018:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc01b7d0/0xce4472dd2237dac8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.246027:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc01b7d0/0xce4472dd2237dac8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.246051:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.246053:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.246055:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.247182:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.247195:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4fe51f0/0xce4472dd2237dacf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.247218:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.247245:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.247251:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4fe51f0/0xce4472dd2237dacf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.247264:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4fe51f0/0xce4472dd2237dacf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.247274:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4fe51f0/0xce4472dd2237dacf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.247282:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4fe51f0/0xce4472dd2237dacf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.247305:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788930103.249048:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.249061:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000328bb2e0/0xce4472dd2237dad6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249079:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.249083:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.249089:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000328bb2e0/0xce4472dd2237dad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249102:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000328bb2e0/0xce4472dd2237dad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249123:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000328bb2e0/0xce4472dd2237dad6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249131:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000328bb2e0/0xce4472dd2237dad6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249155:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788930103.249169:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930103.249175:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4fe51f0/0xce4472dd2237dacf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249183:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930103.249188:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4fe51f0/0xce4472dd2237dacf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249197:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4fe51f0/0xce4472dd2237dacf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249213:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4fe51f0/0xce4472dd2237dacf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249244:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4fe51f0/0xce4472dd2237dacf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249263:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930103.249272:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000328bb2e0/0xce4472dd2237dad6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249279:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930103.249283:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000328bb2e0/0xce4472dd2237dad6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249290:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000328bb2e0/0xce4472dd2237dad6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249301:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000328bb2e0/0xce4472dd2237dad6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249308:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000328bb2e0/0xce4472dd2237dad6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249321:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.249323:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.249324:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.249740:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.249747:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000209f159b/0xce4472dd2237dadd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249756:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.249760:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.249765:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000209f159b/0xce4472dd2237dadd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249786:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000209f159b/0xce4472dd2237dadd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249795:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000209f159b/0xce4472dd2237dadd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249803:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000209f159b/0xce4472dd2237dadd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249820:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930103.249830:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930103.249834:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000209f159b/0xce4472dd2237dadd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249842:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930103.249845:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000209f159b/0xce4472dd2237dadd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249853:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000209f159b/0xce4472dd2237dadd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249864:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000209f159b/0xce4472dd2237dadd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249872:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000209f159b/0xce4472dd2237dadd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.249896:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.249898:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.249900:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.250332:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.250339:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0ea7637/0xce4472dd2237dae4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.250348:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.250351:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.250356:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0ea7637/0xce4472dd2237dae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.250365:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0ea7637/0xce4472dd2237dae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.250374:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0ea7637/0xce4472dd2237dae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.250382:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0ea7637/0xce4472dd2237dae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.250395:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930103.250402:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930103.250406:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0ea7637/0xce4472dd2237dae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.250422:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930103.250426:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0ea7637/0xce4472dd2237dae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.250435:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0ea7637/0xce4472dd2237dae4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.250445:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0ea7637/0xce4472dd2237dae4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.250451:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0ea7637/0xce4472dd2237dae4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.250465:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.250466:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.250468:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930103.251905:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.257739:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.257755:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cee38dd/0xce4472dd2237daeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.257772:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.257777:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.257782:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cee38dd/0xce4472dd2237daeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.257796:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cee38dd/0xce4472dd2237daeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.257815:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cee38dd/0xce4472dd2237daeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.257822:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cee38dd/0xce4472dd2237daeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.257854:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788930103.258497:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930103.258507:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cee38dd/0xce4472dd2237daeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.258517:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930103.258522:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cee38dd/0xce4472dd2237daeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.258533:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cee38dd/0xce4472dd2237daeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.258553:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cee38dd/0xce4472dd2237daeb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.258572:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cee38dd/0xce4472dd2237daeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.258595:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.258597:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.258598:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.258739:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.258745:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096929de/0xce4472dd2237daf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.258755:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.258758:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.258763:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000096929de/0xce4472dd2237daf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.258774:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000096929de/0xce4472dd2237daf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.258782:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096929de/0xce4472dd2237daf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.258790:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000096929de/0xce4472dd2237daf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.259157:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788930103.259767:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.259774:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237daf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.259786:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.259790:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.259795:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237daf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.259805:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237daf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.259815:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237daf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.259822:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237daf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.266567:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788930103.266585:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000096929de/0xce4472dd2237daf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.266601:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930103.266606:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000096929de/0xce4472dd2237daf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.266617:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000096929de/0xce4472dd2237daf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.266639:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000096929de/0xce4472dd2237daf2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.266646:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000096929de/0xce4472dd2237daf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.266671:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930103.266675:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237daf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.266701:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930103.266705:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237daf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.266713:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237daf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.266725:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237daf9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.266734:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.266736:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.266738:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.270922:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788930103.270950:0:15107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237daf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930103.272143:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.274356:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.274371:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237db00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.274683:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.274688:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.274695:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237db00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.274710:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237db00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.274721:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237db00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.274729:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237db00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.274804:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788930103.277784:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.277941:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237db07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.277960:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.277964:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.277971:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237db07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.277988:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237db07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.278011:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237db07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.278020:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237db07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.278178:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788930103.278187:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237db00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.278195:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930103.278200:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237db00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.278210:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237db00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.278245:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237db00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.278260:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237db00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.278283:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930103.278287:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237db07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.278293:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930103.278296:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237db07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.278304:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237db07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.278314:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237db07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.278321:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.278323:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.278325:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.281988:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788930103.282006:0:15107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237db07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930103.282968:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.283983:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.283997:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237db0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.284018:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.284023:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.284029:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237db0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.284046:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237db0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.284056:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237db0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.284078:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237db0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.284112:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788930103.284749:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.284756:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9137638/0xce4472dd2237db15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.284767:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.284771:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.284774:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9137638/0xce4472dd2237db15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.284786:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9137638/0xce4472dd2237db15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.284794:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9137638/0xce4472dd2237db15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930103.285053:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930103.285062:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237db0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930103.285070:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788930103.285075:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237db0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930103.285084:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237db0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930103.285105:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237db0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930103.285112:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237db0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930103.285133:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930103.285135:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930103.285137:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.287316:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9137638/0xce4472dd2237db15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.289204:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788930103.294650:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.294663:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.294688:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.294692:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.294699:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.294714:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.294725:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.294733:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.296549:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788930103.296563:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9137638/0xce4472dd2237db15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.296577:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930103.296594:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9137638/0xce4472dd2237db15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.296605:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9137638/0xce4472dd2237db15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.296625:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9137638/0xce4472dd2237db15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.296633:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9137638/0xce4472dd2237db15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.296653:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930103.296657:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.296663:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930103.296666:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.296674:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.296683:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.296690:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.296698:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.296700:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.300896:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788930103.300914:0:15107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.300970:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.317210:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.317246:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.317267:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.317272:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.317278:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.317301:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.317314:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.317321:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.317341:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788930103.319151:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.319163:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319179:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.319183:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.319189:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319201:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319210:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319251:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319274:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788930103.319289:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930103.319296:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319304:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930103.319310:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319320:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319340:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319348:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ba195c7/0xce4472dd2237db23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319369:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930103.319386:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319406:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930103.319410:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319420:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319431:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319438:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319450:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.319452:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.319453:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.319873:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.319879:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319890:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.319894:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.319899:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319909:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319924:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319943:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319960:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930103.319969:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930103.319973:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319980:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930103.319984:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.319992:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.320004:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.320012:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.320026:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.320034:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.320036:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.320630:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.330123:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.330140:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca9e356/0xce4472dd2237db38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.330159:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.330164:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.330171:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bca9e356/0xce4472dd2237db38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.330187:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bca9e356/0xce4472dd2237db38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.330200:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca9e356/0xce4472dd2237db38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.330209:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bca9e356/0xce4472dd2237db38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.330249:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930103.330269:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930103.330275:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bca9e356/0xce4472dd2237db38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.330283:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930103.330289:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca9e356/0xce4472dd2237db38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.330311:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca9e356/0xce4472dd2237db38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.330329:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bca9e356/0xce4472dd2237db38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.330336:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bca9e356/0xce4472dd2237db38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.330355:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.330357:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.330358:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.333449:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.333461:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6dd89ad/0xce4472dd2237db3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.333477:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.333482:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.333487:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6dd89ad/0xce4472dd2237db3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.333500:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6dd89ad/0xce4472dd2237db3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.333510:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6dd89ad/0xce4472dd2237db3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.333527:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6dd89ad/0xce4472dd2237db3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.333552:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788930103.337569:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930103.337586:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6dd89ad/0xce4472dd2237db3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.337601:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930103.337607:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6dd89ad/0xce4472dd2237db3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.337618:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6dd89ad/0xce4472dd2237db3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.337640:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6dd89ad/0xce4472dd2237db3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.337648:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6dd89ad/0xce4472dd2237db3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.337670:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.337672:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.337674:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.341534:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.341551:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.341571:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.341576:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.341583:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.341600:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.341610:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.341617:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.341637:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930103.341653:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930103.341659:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.341674:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930103.341679:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.341687:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.341704:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.341711:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdf052dd/0xce4472dd2237db46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.341729:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.341731:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930103.341733:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788930103.344447:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788930103.344459:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.344476:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788930103.344480:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930103.344486:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.344501:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.344521:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.344530:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930103.344560:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788930103.344741:0:15107:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:0.0:1788930103.344880:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930103.344889:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.344898:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930103.344909:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.344919:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.344946:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.344953:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bbc28f9/0xce4472dd2237db4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930103.344972:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.344974:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930103.344976:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930103.346549:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14445:x1875828770177664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 146756us (147994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930103.346565:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788930103.348289:0:14445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14445:1875828770177664:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788930103.348311:0:14445:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788930103.348368:0:14445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14445:1875828770177792:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788930103.348986:0:14445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930103.349035:0:14445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e81254540 going to sleep for 11 seconds 00000100:00100000:3.0:1788930103.349105:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770177792 00000100:00100000:3.0:1788930103.349111:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770177792 00000100:00100000:3.0:1788930103.354043:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788930103.354064:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14445:x1875828770177792:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788930103.354118:0:15108:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788930103.367827:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14445:x1875828770177792:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13761us (18830us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788930103.367842:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788930103.368018:0:14445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14445:1875828770177792:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788930103.368036:0:14445:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788930103.645354:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930104.667552:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788930105.460559:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788930105.460578:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1788930105.694019:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930106.718270:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930107.740824:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788930108.379935:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788930108.379943:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788930108.379947:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2e863d3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788930108.379956:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:1.0:1788930108.379970:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788930108.379983:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2e863d3800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930108.380073:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d867c3100 x1875828770178176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788930108.380251:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770178432:0@lo:400:kworker.0 00000100:00100000:1.0:1788930108.380326:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930108.380382:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788930108.380388:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770177920:0@lo:400:kworker.0 00000100:00100000:1.0:1788930108.380417:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930108.380449:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770178048:0@lo:400:kworker.0 00000100:00100000:1.0:1788930108.380475:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930108.380493:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788930108.380497:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770178304:0@lo:400:kworker.0 00000100:00100000:1.0:1788930108.380515:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930108.380546:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770178176:0@lo:8:kworker.0 00000100:00100000:1.0:1788930108.380573:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930108.380602:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770178432 00000100:00100000:1.0:1788930108.380610:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770178432 00000100:00100000:1.0:1788930108.380656:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770178304 00000100:00100000:1.0:1788930108.380659:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770178304 00000100:00100000:1.0:1788930108.380675:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788930108.380683:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770178432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930108.380734:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770178432:12345-0@lo:400:kworker.0 Request processed in 52us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930108.380741:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788930108.380759:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788930108.380771:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770178304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930108.380852:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770178304:12345-0@lo:400:kworker.0 Request processed in 80us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930108.380858:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788930108.380877:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770177920 00000100:00100000:1.0:1788930108.380881:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770177920 00000100:00100000:1.0:1788930108.380905:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788930108.380911:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:3308:x1875828770177920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930108.380939:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:3308:x1875828770177920:12345-0@lo:400:kworker.0 Request processed in 29us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930108.380945:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788930108.380970:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770178048 00000100:00100000:1.0:1788930108.380974:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770178048 00000100:00100000:1.0:1788930108.381006:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770178176 00000100:00100000:1.0:1788930108.381010:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770178176 00000100:00100000:1.0:1788930108.381019:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788930108.381024:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770178048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930108.381055:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770178048:12345-0@lo:400:kworker.0 Request processed in 30us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930108.381060:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788930108.381071:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788930108.381075:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875828770178176:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788930108.381094:0:15107:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788930108.383218:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770178560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788930108.383299:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930108.383355:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770178560 00000100:00100000:0.0:1788930108.383362:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770178560 00000100:00100000:0.0:1788930108.383411:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788930108.383419:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770178560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788930108.383461:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788930108.383530:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770178560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930108.383537:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788930108.383584:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788930108.383607:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770178560:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788930108.384850:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788930108.384861:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788930108.385322:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770177920:0@lo:400:kworker.0 00010000:00080000:0.0:1788930108.385343:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d867c0700 x1875828770178432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930108.385356:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770178432:0@lo:400:kworker.0 00010000:00080000:0.0:1788930108.389372:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d867c0380 x1875828770178304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930108.389396:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770178304:0@lo:400:kworker.0 00000100:00100000:0.0:1788930108.389411:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770178048:0@lo:400:kworker.0 00000100:00100000:1.0:1788930108.417672:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875828770178176:12345-0@lo:8:kworker.0 Request processed in 36589us (37091us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788930108.417687:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788930108.417850:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e863d3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788930108.417858:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788930108.417866:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770178176:0@lo:8:kworker.0 00010000:00010000:1.0:1788930108.763553:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930109.788501:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788930110.300940:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788930110.812451:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788930111.361557:0:15825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788930111.361561:0:15825:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788930111.361706:0:15825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2d84872800 00000020:01000004:2.0:1788930111.361725:0:15825:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788930111.361740:0:15825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788930111.361755:0:15825:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d2e881e19c0) 00000020:00000080:2.0:1788930111.361772:0:15825:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788930111.379561:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788930111.379864:0:15825:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788930111.380886:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788930111.381109:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788930111.381558:0:15825:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788930111.381925:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 573: rc = 0 00100000:10000000:0.0:1788930111.382016:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 573: rc = 0 00100000:10000000:0.0:1788930111.382105:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 573: rc = 0 00100000:10000000:0.0:1788930111.382964:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:0.0:1788930111.383352:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:0.0:1788930111.383769:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:0.0:1788930111.384077:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:0.0:1788930111.384593:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:0.0:1788930111.384853:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00000020:00000080:0.0:1788930111.385648:0:15825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788930111.385664:0:15825:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788930111.385676:0:15825:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xce4472dd2237db5b 00000020:01000004:0.0:1788930111.385687:0:15825:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788930111.385714:0:15825:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.140@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788930111.385718:0:15825:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788930111.385725:0:15825:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788930111.385754:0:15825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788930111.385758:0:15825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788930111.394843:0:15825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788930111.394886:0:15825:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.140@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788930111.394891:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788930111.394893:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788930111.394895:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930111.394896:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930111.394897:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930111.394898:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930111.394900:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788930111.394902:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930111.394903:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788930111.394907:0:15825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788930111.394910:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788930111.394911:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788930111.394912:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930111.394918:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930111.394919:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930111.394920:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930111.394921:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788930111.394921:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930111.394922:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788930111.394968:0:15825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788930111.394993:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770178688:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788930111.395070:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.395277:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86a14840 going to sleep for 11 seconds 00000100:00100000:1.0:1788930111.395446:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770178688 00000100:00100000:1.0:1788930111.395456:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770178688 00000100:00100000:1.0:1788930111.395652:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788930111.395662:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15825:x1875828770178688:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788930111.395692:0:14416:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788930111.395695:0:14416:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788930111.395700:0:14416:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788930111.403336:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15825:x1875828770178688:12345-0@lo:253:mount.lustre.0 Request processed in 7665us (8255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930111.403352:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788930111.403445:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770178688:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788930111.403463:0:15825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788930111.403466:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788930111.403468:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788930111.403470:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930111.403471:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930111.403472:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930111.403473:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930111.403475:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788930111.403477:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930111.403478:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788930111.403516:0:15825:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2d84872800 from lustre-OST0001 10000000:01000000:0.0:1788930111.403546:0:15825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788930111.403549:0:15825:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788930111.403556:0:15825:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2eb5b88000 local copy 00010000:00010000:0.0:1788930111.403568:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d90f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930111.403834:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770178816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930111.403875:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.403913:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788930111.404155:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770178816 00000100:00100000:3.0:1788930111.404161:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770178816 00000100:00100000:3.0:1788930111.404381:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788930111.404392:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e91368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15825:x1875828770178816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930111.404662:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e91368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15825:x1875828770178816:12345-0@lo:501:mount.lustre.0 Request processed in 272us (785us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788930111.404670:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788930111.404740:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770178816:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788930111.404769:0:15825:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788930111.404934:0:15825:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788930111.404942:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d90f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930111.404954:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d90f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930111.404980:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2d84872800 10000000:01000000:0.0:1788930111.404984:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788930111.404990:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788930111.404992:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788930111.404998:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788930111.405000:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788930111.405026:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930111.405035:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930111.405044:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930111.405060:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770178944:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788930111.405091:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.405466:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788930111.405546:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770178944 00000100:00100000:2.0:1788930111.405552:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770178944 00000100:00100000:2.0:1788930111.405579:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788930111.405585:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:15825:x1875828770178944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930111.405597:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930111.405610:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5340800/0xce4472dd2237db69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237db62 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930111.405633:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5340800/0xce4472dd2237db69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237db62 expref: 17 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930111.405644:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5340800/0xce4472dd2237db69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237db62 expref: 17 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930111.405665:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340800, rc 0) 00000100:00100000:2.0:1788930111.405710:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:15825:x1875828770178944:12345-0@lo:101:mount.lustre.0 Request processed in 124us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930111.405716:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788930111.405810:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770178944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788930111.405824:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930111.405845:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788930111.406533:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788930111.407430:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788930111.407703:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788930111.407752:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788930111.407800:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788930111.407852:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788930111.407892:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788930111.407925:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788930111.407984:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788930111.407992:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788930111.408083:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930111.408148:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.408191:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788930111.408418:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770179072 00000100:00100000:2.0:1788930111.408426:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770179072 00000100:00100000:2.0:1788930111.408463:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788930111.408472:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:15825:x1875828770179072:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930111.408849:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:15825:x1875828770179072:12345-0@lo:501:mount.lustre.0 Request processed in 377us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930111.408858:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788930111.409018:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930111.409059:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788930111.409103:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.409123:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788930111.409170:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770179200 00000100:00100000:2.0:1788930111.409174:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770179200 00000100:00100000:2.0:1788930111.409195:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788930111.409202:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:15825:x1875828770179200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788930111.409496:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:15825:x1875828770179200:12345-0@lo:503:mount.lustre.0 Request processed in 293us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930111.409502:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788930111.409675:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179200:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788930111.410179:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788930111.410383:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179328:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930111.410426:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.410446:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788930111.410501:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770179328 00000100:00100000:2.0:1788930111.410506:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770179328 00000100:00100000:2.0:1788930111.410532:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788930111.410538:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e91369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:15825:x1875828770179328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788930111.410725:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e91369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:15825:x1875828770179328:12345-0@lo:502:mount.lustre.0 Request processed in 186us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930111.410733:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788930111.410827:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930111.411051:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788930111.411094:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788930111.411127:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788930111.411173:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788930111.411210:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788930111.411388:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788930111.411437:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788930111.411473:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788930111.411523:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788930111.411555:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930111.411601:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.411672:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788930111.411731:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770179456 00000100:00100000:3.0:1788930111.411737:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770179456 00000100:00100000:1.0:1788930111.411820:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788930111.411831:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e91369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:15825:x1875828770179456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788930111.411998:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e91369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:15825:x1875828770179456:12345-0@lo:502:mount.lustre.0 Request processed in 169us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930111.412004:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788930111.412106:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930111.412173:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788930111.412184:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788930111.413121:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788930111.413130:0:15826:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788930111.413137:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788930111.413139:0:15826:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788930111.413147:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788930111.413160:0:15826:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d2e881e0000) 00000020:00000080:2.0:1788930111.413182:0:15826:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788930111.413188:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788930111.413378:0:15826:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2d84872800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788930111.413386:0:15826:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788930111.413394:0:15826:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xce4472dd2237db77 00010000:00010000:2.0:1788930111.419792:0:15826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788930111.420443:0:15826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788930111.422507:0:15826:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788930111.423835:0:15826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788930111.423848:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788930111.423855:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788930111.423857:0:15826:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788930111.423860:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788930111.423864:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788930111.423866:0:15826:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788930111.423869:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788930111.423871:0:15826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788930111.423873:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788930111.423875:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788930111.423877:0:15826:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788930111.423879:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788930111.423881:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788930111.423882:0:15826:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788930111.423885:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788930111.423941:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788930111.423945:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788930111.423947:0:15826:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788930111.423959:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788930111.432274:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788930111.432339:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788930111.432366:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930111.432382:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930111.432429:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2d84872800 from 1 10000000:01000000:0.0:1788930111.432433:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788930111.432510:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930111.432519:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930111.432540:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930111.432566:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788930111.432635:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.432670:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788930111.432966:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770179584 00000100:00100000:3.0:1788930111.432975:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770179584 00000100:00100000:3.0:1788930111.433037:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788930111.433047:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:15825:x1875828770179584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930111.433061:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930111.433074:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237db85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237db7e expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930111.433113:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237db85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237db7e expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930111.433125:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237db85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237db7e expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930111.433135:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8677ca00, rc 0) 00000100:00100000:3.0:1788930111.433181:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:15825:x1875828770179584:12345-0@lo:101:mount.lustre.0 Request processed in 135us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930111.433200:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788930111.433617:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788930111.433637:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237db85 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930111.433654:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237db85 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788930111.434638:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788930111.435363:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788930111.435804:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788930111.435877:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788930111.435938:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788930111.435945:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788930111.436038:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930111.436186:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.436457:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788930111.436589:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770179712 00000100:00100000:1.0:1788930111.436597:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770179712 00000100:00100000:1.0:1788930111.436693:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788930111.436704:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e91369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:15825:x1875828770179712:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788930111.436967:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e91369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:15825:x1875828770179712:12345-0@lo:501:mount.lustre.0 Request processed in 265us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930111.436976:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788930111.437038:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930111.437078:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788930111.437133:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.437558:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788930111.437762:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770179840 00000100:00100000:3.0:1788930111.437769:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770179840 00000100:00100000:3.0:1788930111.437810:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788930111.437818:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebe0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:15825:x1875828770179840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930111.438260:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebe0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:15825:x1875828770179840:12345-0@lo:503:mount.lustre.0 Request processed in 442us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930111.438267:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788930111.438493:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179840:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788930111.439029:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788930111.439131:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179968:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930111.439194:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.439278:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788930111.439660:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770179968 00000100:00100000:3.0:1788930111.439667:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770179968 00000100:00100000:3.0:1788930111.439703:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788930111.439712:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5436c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:15825:x1875828770179968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788930111.439955:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5436c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:15825:x1875828770179968:12345-0@lo:502:mount.lustre.0 Request processed in 244us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930111.439962:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788930111.440171:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770179968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930111.440794:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788930111.440851:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788930111.440896:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788930111.440933:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788930111.440965:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788930111.441015:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788930111.441049:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788930111.441084:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788930111.441212:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770180096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930111.441572:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.441653:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788930111.441726:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770180096 00000100:00100000:2.0:1788930111.441734:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770180096 00000100:00100000:3.0:1788930111.441846:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788930111.441858:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:15825:x1875828770180096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788930111.442052:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:15825:x1875828770180096:12345-0@lo:502:mount.lustre.0 Request processed in 196us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930111.442059:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788930111.442197:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770180096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930111.442461:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788930111.442578:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788930111.443888:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930111.443900:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930111.443903:0:15830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788930111.443909:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2d84872800 00000020:00000080:3.0:1788930111.443912:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788930111.443919:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930111.443933:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930111.443935:0:15830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788930111.443938:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930111.443940:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930111.443941:0:15830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788930111.443944:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2d84872800 00000020:00000080:3.0:1788930111.443946:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788930111.444036:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930111.444040:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930111.444042:0:15830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788930111.444044:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930111.444046:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930111.444048:0:15830:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788930111.444051:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2d84872800 00000020:00000080:3.0:1788930111.444053:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788930111.445565:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930111.445578:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930111.445581:0:15830:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788930111.445585:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788930111.448677:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788930111.448730:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788930111.448748:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237db85 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930111.448762:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237db85 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930111.448834:0:15825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788930111.448838:0:15825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2d84872800 10000000:01000000:0.0:1788930111.448841:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2d84872800 10000000:01000000:0.0:1788930111.448845:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788930111.448852:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2d84872800 from 1 10000000:01000000:0.0:1788930111.448855:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788930111.448892:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930111.448901:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930111.448913:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930111.448940:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770180224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788930111.449015:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.455677:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788930111.456213:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770180224 00000100:00100000:3.0:1788930111.457209:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770180224 00000100:00100000:3.0:1788930111.459212:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788930111.459249:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:15825:x1875828770180224:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930111.459273:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930111.459297:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d8677c400/0xce4472dd2237db93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237db8c expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930111.459329:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d8677c400/0xce4472dd2237db93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237db8c expref: 19 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930111.459340:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d8677c400/0xce4472dd2237db93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237db8c expref: 19 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930111.459362:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8677c400, rc 0) 00000100:00100000:3.0:1788930111.459453:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:15825:x1875828770180224:12345-0@lo:101:mount.lustre.0 Request processed in 228us (10437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930111.459460:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788930111.459982:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770180224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788930111.460006:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930111.460017:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788930111.464850:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788930111.467988:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788930111.472759:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788930111.472873:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788930111.472905:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788930111.472950:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788930111.472982:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788930111.475382:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788930111.475585:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788930111.475634:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788930111.475748:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788930111.475816:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788930111.475865:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788930111.475940:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788930111.475977:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788930111.476004:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788930111.476047:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788930111.478340:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788930111.478438:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788930111.479442:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788930111.480398:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788930111.480450:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788930111.480762:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788930111.480813:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788930111.480850:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788930111.480897:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788930111.480926:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788930111.480952:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788930111.481029:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788930111.481065:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788930111.482609:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788930111.482725:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788930111.482784:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788930111.482848:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788930111.482884:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788930111.482930:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788930111.482973:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788930111.483021:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788930111.483056:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788930111.487818:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788930111.487847:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788930111.487969:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770180352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930111.488871:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.488992:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788930111.491765:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770180352 00000100:00100000:3.0:1788930111.491792:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770180352 00000100:00100000:2.0:1788930111.491889:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788930111.491900:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:15825:x1875828770180352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930111.492335:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:15825:x1875828770180352:12345-0@lo:501:mount.lustre.0 Request processed in 434us (3465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930111.492343:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788930111.492473:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770180352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930111.492533:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770180480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788930111.492588:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.492625:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d85c7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788930111.494965:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770180480 00000100:00100000:3.0:1788930111.494982:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770180480 00000100:00100000:3.0:1788930111.495101:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788930111.495112:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:15825:x1875828770180480:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930111.495478:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:15825:x1875828770180480:12345-0@lo:503:mount.lustre.0 Request processed in 368us (2888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930111.495486:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788930111.495592:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770180480:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788930111.496487:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788930111.496591:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770180608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788930111.496657:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930111.508754:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9810ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788930111.512842:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770180608 00000100:00100000:0.0:1788930111.512861:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770180608 00000100:00100000:0.0:1788930111.512926:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788930111.512936:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:15825:x1875828770180608:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930111.514063:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:15825:x1875828770180608:12345-0@lo:502:mount.lustre.0 Request processed in 1122us (17400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930111.514075:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788930111.514292:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770180608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788930111.514609:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788930111.514666:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788930111.514700:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788930111.514749:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788930111.514799:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788930111.514853:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788930111.514889:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788930111.514952:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788930111.515006:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788930111.515043:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788930111.515077:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788930111.515124:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788930111.515162:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788930111.515197:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788930111.515277:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788930111.515316:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788930111.515349:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788930111.515396:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788930111.515432:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788930111.515465:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788930111.515512:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788930111.515546:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788930111.515579:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788930111.515647:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788930111.515685:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788930111.515713:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788930111.515757:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788930111.515809:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788930111.515844:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788930111.515887:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788930111.515932:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788930111.515965:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788930111.515999:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788930111.516049:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788930111.516084:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788930111.516131:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788930111.516167:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788930111.516201:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788930111.516281:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788930111.517073:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788930111.517210:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770180736:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788930111.517872:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930111.517972:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9810ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788930111.521838:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770180736 00000100:00100000:3.0:1788930111.521857:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770180736 00000100:00100000:3.0:1788930111.523313:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788930111.523335:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:15825:x1875828770180736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788930111.523702:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:15825:x1875828770180736:12345-0@lo:502:mount.lustre.0 Request processed in 377us (5831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930111.523711:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788930111.523866:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770180736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788930111.523997:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788930111.524013:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788930111.536754:0:15835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788930111.536787:0:15835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d2e916299c0) 00000020:00000080:3.0:1788930111.536814:0:15835:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788930111.536897:0:15835:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2d84872800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788930111.536902:0:15835:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2d84872800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788930111.536905:0:15835:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2d84872800 3 00010000:00080000:3.0:1788930111.536954:0:15835:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2eb5b81000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.140@tcp at head 00010000:00010000:3.0:1788930111.543557:0:15835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788930111.543946:0:15835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788930111.543985:0:15835:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788930111.544000:0:15835:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xce4472dd2237dba1 00000100:00080000:3.0:1788930111.544011:0:15835:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788930111.544023:0:15835:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2eb5b81000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:3.0:1788930111.545448:0:15835:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d85d3c380 x1875828770180864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788930111.545853:0:15835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788930111.545992:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788930111.545997:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788930111.546001:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2e863d3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788930111.546006:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:1.0:1788930111.546010:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788930111.546021:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2e863d3800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930111.546037:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d867c1c00 x1875828770181120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788930111.546104:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770181248:0@lo:400:kworker.0 00000100:00100000:1.0:1788930111.546176:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930111.546396:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788930111.546419:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770180992:0@lo:400:kworker.0 00000100:00100000:1.0:1788930111.546447:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930111.546554:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770181376:0@lo:400:kworker.0 00000100:00100000:1.0:1788930111.546585:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930111.546631:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770181248 00000100:00100000:1.0:1788930111.546643:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770181248 00000100:00100000:1.0:1788930111.546692:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770181376 00000100:00100000:1.0:1788930111.546695:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770181376 00000100:00100000:1.0:1788930111.546725:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788930111.547586:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875828770180864:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788930111.547646:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930111.547678:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770181120:0@lo:8:kworker.0 00000100:00100000:0.0:1788930111.547702:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930111.548378:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770181248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930111.548458:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770181248:12345-0@lo:400:kworker.0 Request processed in 1725us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930111.548616:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788930111.548647:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770180864 00000100:00100000:1.0:1788930111.548654:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770180864 00000100:00100000:1.0:1788930111.548675:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788930111.548684:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770181376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930111.548731:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770181376:12345-0@lo:400:kworker.0 Request processed in 49us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930111.548737:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788930111.548754:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788930111.548758:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875828770180864:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788930111.548792:0:14421:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:1.0:1788930111.548831:0:14421:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xce4472dd2237dba8 00000004:00100000:1.0:1788930111.548849:0:14421:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788930111.548883:0:14421:0:(import.c:65:import_set_state_nolock()) ffff8d2d84828000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788930111.548927:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875828770180864:12345-0@lo:38:llog_process_th.0 Request processed in 167us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930111.548945:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788930111.548972:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770180992 00000100:00100000:1.0:1788930111.548976:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770180992 00000100:00100000:1.0:1788930111.549004:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770181120 00000100:00100000:1.0:1788930111.549008:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770181120 00000100:00100000:1.0:1788930111.549019:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788930111.549026:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770180992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930111.549056:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770180992:12345-0@lo:400:kworker.0 Request processed in 31us (2609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930111.549061:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788930111.549072:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788930111.549076:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875828770181120:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788930111.549340:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770180992:0@lo:400:kworker.0 00010000:00080000:0.0:1788930111.549357:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d867c0a80 x1875828770181248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930111.549383:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770181248:0@lo:400:kworker.0 00010000:00080000:3.0:1788930111.549510:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d867c1880 x1875828770181376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788930111.549520:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770181376:0@lo:400:kworker.0 00000100:00080000:0.0:1788930111.551115:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788930111.551124:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788930111.551865:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875828770181120:12345-0@lo:8:kworker.0 Request processed in 2779us (4153us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788930111.551879:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788930111.551966:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d85d3c380 x1875828770180864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788930121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930111.551978:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788930111.551988:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788930111.551996:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788930111.552002:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788930111.552004:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2eb5b81000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788930111.552011:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875828770180864:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788930111.552022:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788930111.552025:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e863d3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788930111.552029:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788930111.552040:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770181120:0@lo:8:kworker.0 00000040:00080000:3.0:1788930111.552408:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788930111.553188:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788930111.553563:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788930111.553620:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.553633:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788930111.553690:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788930111.553692:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788930111.553694:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788930111.553696:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788930111.553697:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788930111.553698:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788930111.553700:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788930111.553701:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788930111.553702:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788930111.553706:0:15825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788930111.553709:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788930111.553710:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788930111.553711:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788930111.553712:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788930111.553713:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788930111.553714:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788930111.553715:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788930111.553717:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788930111.553718:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788930111.553749:0:15825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788930111.553770:0:15825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770181504:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788930111.553870:0:15825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930111.553919:0:15825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9810ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788930111.557595:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770181504 00000100:00100000:0.0:1788930111.557611:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770181504 00000100:00100000:0.0:1788930111.557669:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788930111.557679:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:15825:x1875828770181504:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788930111.557718:0:14417:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788930111.557743:0:14417:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788930111.602718:0:14417:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788930111.602742:0:14417:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788930111.604727:0:14438:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788930111.604736:0:14438:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788930111.604761:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930111.604795:0:14438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2eb5341e00/0xce4472dd2237da89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237da82 expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930111.604805:0:14438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930111.604848:0:14438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2eb5341e00/0xce4472dd2237da89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237da82 expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930111.604862:0:14438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2eb5341e00/0xce4472dd2237da89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237da82 expref: 19 pid: 14416 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930111.604879:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14438:1875828770181632:0@lo:104: 00000100:00100000:2.0:1788930111.604953:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930111.605000:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e902860c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788930111.605062:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770181632 00000100:00100000:1.0:1788930111.605071:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770181632 00000100:00100000:1.0:1788930111.605159:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788930111.605168:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+3:14438:x1875828770181632:12345-0@lo:104: 00010000:00010000:1.0:1788930111.605183:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237da89 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605274:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788930111.605280:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+3:14438:x1875828770181632:12345-0@lo:104: Request processed in 114us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930111.605287:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788930111.605309:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930111.605317:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237da89 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605324:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677de00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788930111.605329:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237da89 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605338:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237da89 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788930111.605346:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237da89 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788930111.605353:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788930111.605381:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237da89 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605388:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788930111.605406:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237da89 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605423:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2d8677de00/0xce4472dd2237da82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237da89 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605440:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930111.605442:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930111.605443:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930111.605457:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770181760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788930111.605759:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930111.605811:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770181760 00000100:00100000:1.0:1788930111.605816:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770181760 00010000:00010000:1.0:1788930111.605835:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2eb5341e00/0xce4472dd2237da89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237da82 expref: 20 pid: 14416 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930111.605859:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788930111.605866:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+20:3309:x1875828770181760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930111.605877:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930111.605882:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2eb5341e00/0xce4472dd2237da89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237da82 expref: 20 pid: 14416 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605893:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2eb5341e00/0xce4472dd2237da89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237da82 expref: 20 pid: 14416 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605910:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605918:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788930111.605932:0:14407:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011894364s 00010000:00010000:1.0:1788930111.605944:0:14407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605951:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605957:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605964:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605969:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930111.605974:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605981:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605990:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.605999:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930111.606029:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+20:3309:x1875828770181760:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930111.606037:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788930111.606082:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770181760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930111.606127:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5341e00/0xce4472dd2237da89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237da82 expref: 19 pid: 14416 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930111.606138:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14438:1875828770181632:0@lo:104: 00010000:00010000:1.0:1788930111.606159:0:14438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.606168:0:14438:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.606174:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930111.606181:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dbaf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930111.614863:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5434050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:15825:x1875828770181504:12345-0@lo:253:mount.lustre.0 Request processed in 57169us (60977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930111.614885:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788930111.614984:0:15825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:15825:1875828770181504:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788930111.615002:0:15825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788930111.615005:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788930111.615007:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788930111.615008:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788930111.615009:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788930111.615011:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788930111.615012:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788930111.615013:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788930111.615015:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788930111.615017:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788930111.615033:0:15825:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788930111.623930:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930111.624078:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788930111.624636:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930111.624884:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788930111.625034:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930111.625792:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788930111.631728:0:15825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788930111.716923:0:15825:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788930111.716933:0:15825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788930111.716985:0:15825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788930111.717046:0:15825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788930111.717063:0:15825:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788930111.717095:0:15825:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788930111.843442:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930112.865577:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930113.500524:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770181888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788930113.500611:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930113.500714:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770181888 00000100:00100000:0.0:1788930113.500723:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770181888 00000100:00100000:0.0:1788930113.500797:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788930113.500807:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770181888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788930113.500841:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788930113.500891:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770181888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930113.500898:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788930113.500944:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770181888:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788930113.501081:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1788930113.630261:0:14419:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788930113.630270:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2ebe0db800 from 8 10000000:01000000:3.0:1788930113.630275:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788930113.630328:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930113.630340:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930113.630364:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930113.630390:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770182016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788930113.630462:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930113.630511:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e91701600 going to sleep for 11 seconds 00000100:00100000:0.0:1788930113.630617:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770182016 00000100:00100000:0.0:1788930113.630627:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770182016 00000100:00100000:0.0:1788930113.630769:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788930113.630779:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:14419:x1875828770182016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788930113.630792:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930113.630809:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b9600/0xce4472dd2237dbbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237dbb6 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930113.630830:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b9600/0xce4472dd2237dbbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237dbb6 expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930113.630841:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebe0b9600/0xce4472dd2237dbbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237dbb6 expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930113.630849:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9600, rc 0) 00000100:00100000:0.0:1788930113.630894:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:14419:x1875828770182016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930113.630900:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788930113.630981:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770182016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788930113.630995:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930113.631004:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930113.631048:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770182144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788930113.631075:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930113.631102:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e91701600 going to sleep for 11 seconds 00000100:00100000:0.0:1788930113.631153:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770182144 00000100:00100000:0.0:1788930113.631157:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770182144 00000100:00100000:0.0:1788930113.631196:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788930113.631203:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:14419:x1875828770182144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788930113.631216:0:14417:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788930113.631253:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788930113.631256:0:14417:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788930113.631330:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:14419:x1875828770182144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930113.631336:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788930113.631462:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770182144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788930113.631525:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788930113.631532:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930113.631540:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930113.888634:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930114.907377:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930115.931537:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788930116.573557:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788930116.573565:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788930116.573569:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2e863d3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788930116.573588:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2e863d3800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930116.573619:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d867c0e00 x1875828770182528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788930116.573700:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770182784:0@lo:400:kworker.0 00000100:00100000:1.0:1788930116.573765:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930116.573839:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788930116.573846:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770182272:0@lo:400:kworker.0 00000100:00100000:1.0:1788930116.573879:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930116.573904:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770182912:0@lo:400:kworker.0 00000100:00100000:1.0:1788930116.573924:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930116.573949:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770182400:0@lo:400:kworker.0 00000100:00100000:1.0:1788930116.573975:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930116.573994:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788930116.573999:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770182656:0@lo:400:kworker.0 00000100:00100000:1.0:1788930116.574019:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930116.574042:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770182528:0@lo:8:kworker.0 00000100:00100000:1.0:1788930116.574063:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930116.574091:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770182784 00000100:00100000:1.0:1788930116.574102:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770182784 00000100:00100000:1.0:1788930116.574151:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770182912 00000100:00100000:1.0:1788930116.574154:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770182912 00000100:00100000:1.0:1788930116.574177:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770182656 00000100:00100000:1.0:1788930116.574181:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770182656 00000100:00100000:1.0:1788930116.574194:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788930116.574204:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770182784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930116.574300:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770182784:12345-0@lo:400:kworker.0 Request processed in 96us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930116.574308:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788930116.574326:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788930116.574333:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770182912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930116.574359:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770182912:12345-0@lo:400:kworker.0 Request processed in 27us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930116.574365:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788930116.574377:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788930116.574382:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770182656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930116.574412:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770182656:12345-0@lo:400:kworker.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930116.574417:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788930116.574436:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770182272 00000100:00100000:1.0:1788930116.574440:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770182272 00000100:00100000:1.0:1788930116.574461:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788930116.574467:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3310:x1875828770182272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930116.574494:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3310:x1875828770182272:12345-0@lo:400:kworker.0 Request processed in 27us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930116.574500:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788930116.574528:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770182400 00000100:00100000:1.0:1788930116.574531:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770182400 00000100:00100000:1.0:1788930116.574554:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770182528 00000100:00100000:1.0:1788930116.574563:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770182528 00000100:00100000:1.0:1788930116.574579:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788930116.574585:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770182400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930116.574615:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770182400:12345-0@lo:400:kworker.0 Request processed in 30us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930116.574621:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788930116.574632:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788930116.574635:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875828770182528:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788930116.574661:0:15106:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:1.0:1788930116.574700:0:15106:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237dbc4 00002000:00100000:1.0:1788930116.574712:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d2d8482f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788930116.574716:0:15106:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788930116.574718:0:15106:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788930116.575077:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788930116.575105:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d2d8482d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788930116.575153:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770182272:0@lo:400:kworker.0 00000100:00100000:1.0:1788930116.575161:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875828770182528:12345-0@lo:8:kworker.0 Request processed in 522us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930116.575172:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788930116.575173:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d867c0000 x1875828770182912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930116.575186:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770182912:0@lo:400:kworker.0 00010000:00080000:1.0:1788930116.575213:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d867c0e00 x1875828770182528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788930141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788930116.575218:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d867c0a80 x1875828770182784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788930116.575250:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788930116.575259:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1788930116.575266:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770182784:0@lo:400:kworker.0 00000100:00080000:1.0:1788930116.575267:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788930116.575272:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e863d3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788930116.575285:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788930116.575292:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770182528:0@lo:8:kworker.0 00010000:00080000:1.0:1788930116.575354:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d867c1880 x1875828770182656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930116.575364:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770182656:0@lo:400:kworker.0 00000100:00080000:3.0:1788930116.575460:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788930116.575467:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788930116.575523:0:14447:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788930116.575544:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14447:1875828770183168:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788930116.575581:0:14447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930116.575601:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84b1f6c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788930116.575615:0:14446:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788930116.576058:0:14446:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 501731832819ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788930116.576284:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770183168 00000100:00100000:3.0:1788930116.576291:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770183168 00000100:00100000:3.0:1788930116.576334:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788930116.576342:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14447:x1875828770183168:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788930116.578495:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770182400:0@lo:400:kworker.0 00000100:00100000:0.0:1788930116.578531:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770183040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788930116.578594:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930116.578656:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770183040 00000100:00100000:0.0:1788930116.578663:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770183040 00000100:00100000:0.0:1788930116.578720:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788930116.578730:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875828770183040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788930116.578768:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788930116.578815:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875828770183040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930116.578821:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788930116.578855:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2d85d3e680 x1875828770183040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788930132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930116.578872:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770183040:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788930116.583900:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788930116.587604:0:15108:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788930116.587618:0:15108:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788930116.587623:0:15108:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1788930116.606884:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.606897:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbcb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.606916:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.606920:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.606927:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.606946:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.606958:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.606978:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.607001:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788930116.607014:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930116.607019:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.607026:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677dc00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788930116.607031:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.607039:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.607056:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbcb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.607063:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbcb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.607079:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.607080:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.607082:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788930116.608925:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.608945:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dbd2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.608960:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.608964:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.608970:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dbd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.608983:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dbd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.608993:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dbd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.609001:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dbd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.609018:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788930116.609028:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930116.609033:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dbd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.609040:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788930116.609044:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dbd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.609051:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dbd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.609074:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dbd2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.609081:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dbd2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.609098:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.609100:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.609101:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788930116.609729:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.609736:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dbd9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.609745:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.609748:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.609752:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dbd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.609761:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dbd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.609770:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dbd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.609778:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dbd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.609858:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788930116.610308:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.610314:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dbe0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.610322:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.610325:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.610328:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dbe0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.610337:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dbe0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.610345:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dbe0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.610352:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dbe0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.610445:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788930116.610467:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dbd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.610476:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930116.610479:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dbd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.610498:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dbd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.610515:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dbd9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.610523:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dbd9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.610541:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930116.610544:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dbe0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.610551:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930116.610554:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dbe0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.610560:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dbe0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.610568:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dbe0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.610575:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.610576:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.610584:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.612854:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788930116.612870:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dbe0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788930116.614051:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.614064:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbe7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.614391:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.614396:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.614403:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbe7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.614419:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbe7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.614431:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbe7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.614439:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbe7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.614688:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788930116.615193:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.615200:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dbee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.615210:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.615214:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.615218:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dbee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.615249:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dbee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.615269:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dbee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.615291:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dbee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.621737:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788930116.621757:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbe7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.621774:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677c000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930116.621779:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbe7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.621791:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbe7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.621814:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbe7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.621821:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbe7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.621852:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930116.621857:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dbee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.621864:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930116.621867:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dbee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.621876:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dbee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.621909:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dbee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.621917:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.621919:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.621921:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.628471:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.635147:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788930116.635167:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dbee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.635221:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788930116.640410:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.640424:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbf5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.640442:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.640447:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.640453:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.640469:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.640481:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.640501:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.640533:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930116.640960:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930116.640968:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.640977:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677dc00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930116.640981:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.640990:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.641012:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbf5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.641019:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7e9295c/0xce4472dd2237dbf5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.641041:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.641043:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.641045:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788930116.641640:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.641648:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbfc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.641659:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.641662:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.641667:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.641688:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.641697:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.641705:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.641728:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788930116.641990:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930116.641997:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.642005:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677c000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930116.642009:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.642017:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.642030:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbfc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.642036:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000227fef84/0xce4472dd2237dbfc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.642052:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.642054:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.642055:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788930116.644451:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.644467:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dc03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.644493:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.644497:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.644503:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dc03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.644519:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dc03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.644530:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dc03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.644539:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dc03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.646934:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930116.650909:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930116.650931:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dc03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.650944:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930116.650949:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dc03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.650961:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dc03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.650982:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dc03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.650990:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002328cabc/0xce4472dd2237dc03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.651013:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.651015:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.651016:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788930116.651284:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.651293:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dc0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.651309:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.651313:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.651320:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dc0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.651345:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dc0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.651888:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dc0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.651901:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dc0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.651924:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788930116.653063:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.653076:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dc11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.653092:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.653096:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.653102:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dc11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.653117:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dc11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.653127:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dc11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.653135:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dc11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.653166:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788930116.653175:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930116.653185:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dc0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.653196:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930116.653201:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dc0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.653249:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dc0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.653271:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dc0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.653720:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac807d9f/0xce4472dd2237dc0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.653768:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930116.653772:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dc11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.653778:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930116.653782:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dc11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.653789:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dc11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.653801:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dc11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.653807:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090f7d540/0xce4472dd2237dc11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.653834:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.653836:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.653837:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788930116.654618:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.654627:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dc18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.654638:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.654643:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.654732:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dc18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.654748:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dc18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.654758:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dc18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.654766:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dc18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.654857:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930116.655245:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930116.655254:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dc18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.655264:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677d400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930116.655270:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dc18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.655392:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788930116.655867:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.655874:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0dec468/0xce4472dd2237dc1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.655885:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.655895:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.655899:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0dec468/0xce4472dd2237dc1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.655911:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0dec468/0xce4472dd2237dc1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.655921:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0dec468/0xce4472dd2237dc1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.655928:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0dec468/0xce4472dd2237dc1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.656019:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930116.656364:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dc18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.656384:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dc18 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.656392:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fd9fdb5/0xce4472dd2237dc18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.656412:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930116.656416:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0dec468/0xce4472dd2237dc1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.656423:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677de00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930116.656434:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0dec468/0xce4472dd2237dc1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.656443:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0dec468/0xce4472dd2237dc1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788930116.657038:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.657045:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4b77cb6/0xce4472dd2237dc26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.657057:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.657060:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.657065:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b77cb6/0xce4472dd2237dc26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.657075:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4b77cb6/0xce4472dd2237dc26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.657086:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4b77cb6/0xce4472dd2237dc26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.657099:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b77cb6/0xce4472dd2237dc26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.657109:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930116.657674:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0dec468/0xce4472dd2237dc1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.657696:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0dec468/0xce4472dd2237dc1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.657716:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930116.657720:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4b77cb6/0xce4472dd2237dc26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.657727:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930116.657731:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4b77cb6/0xce4472dd2237dc26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.657738:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4b77cb6/0xce4472dd2237dc26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.657749:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4b77cb6/0xce4472dd2237dc26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.657755:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4b77cb6/0xce4472dd2237dc26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.657775:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.657778:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.657780:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788930116.658019:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788930116.658033:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.658044:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e36eb723/0xce4472dd2237dc2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.658055:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.658059:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.658063:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e36eb723/0xce4472dd2237dc2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.658073:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e36eb723/0xce4472dd2237dc2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.658081:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e36eb723/0xce4472dd2237dc2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.658088:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e36eb723/0xce4472dd2237dc2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.658121:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788930116.658269:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930116.658286:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e36eb723/0xce4472dd2237dc2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.658295:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930116.658300:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e36eb723/0xce4472dd2237dc2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.658307:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e36eb723/0xce4472dd2237dc2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.658321:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e36eb723/0xce4472dd2237dc2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.658328:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e36eb723/0xce4472dd2237dc2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.658345:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.658347:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.658349:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.658527:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788930116.659127:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.659135:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043a52e43/0xce4472dd2237dc34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.659152:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.659155:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.659159:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043a52e43/0xce4472dd2237dc34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.659170:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043a52e43/0xce4472dd2237dc34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.659180:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043a52e43/0xce4472dd2237dc34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.659187:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043a52e43/0xce4472dd2237dc34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.659208:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788930116.660064:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.660074:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba2944d2/0xce4472dd2237dc3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.660085:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.660088:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.660091:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba2944d2/0xce4472dd2237dc3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.660103:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba2944d2/0xce4472dd2237dc3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.660123:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba2944d2/0xce4472dd2237dc3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.660130:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba2944d2/0xce4472dd2237dc3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.660150:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788930116.660920:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.660928:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2965ac/0xce4472dd2237dc42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.661005:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.661010:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.661015:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d2965ac/0xce4472dd2237dc42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.661026:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d2965ac/0xce4472dd2237dc42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.661035:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2965ac/0xce4472dd2237dc42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.661042:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d2965ac/0xce4472dd2237dc42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.661061:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788930116.661487:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.661493:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0cdc31a/0xce4472dd2237dc49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.661501:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.661504:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.661508:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0cdc31a/0xce4472dd2237dc49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.661518:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0cdc31a/0xce4472dd2237dc49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.661535:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0cdc31a/0xce4472dd2237dc49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.661541:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0cdc31a/0xce4472dd2237dc49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.661549:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788930116.662289:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788930116.662299:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043a52e43/0xce4472dd2237dc34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662310:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597e00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930116.662315:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043a52e43/0xce4472dd2237dc34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662337:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043a52e43/0xce4472dd2237dc34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662356:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043a52e43/0xce4472dd2237dc34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662363:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043a52e43/0xce4472dd2237dc34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662382:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788930116.662385:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba2944d2/0xce4472dd2237dc3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662391:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930116.662394:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba2944d2/0xce4472dd2237dc3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662401:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba2944d2/0xce4472dd2237dc3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662411:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba2944d2/0xce4472dd2237dc3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662419:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba2944d2/0xce4472dd2237dc3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788930116.662432:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.662444:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a169fb7/0xce4472dd2237dc50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662462:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788930116.662467:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d2965ac/0xce4472dd2237dc42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662474:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930116.662478:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2965ac/0xce4472dd2237dc42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662485:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2965ac/0xce4472dd2237dc42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662496:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d2965ac/0xce4472dd2237dc42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662504:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d2965ac/0xce4472dd2237dc42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.662515:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1788930116.662517:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930116.662521:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0cdc31a/0xce4472dd2237dc49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662527:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930116.662530:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0cdc31a/0xce4472dd2237dc49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662549:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0cdc31a/0xce4472dd2237dc49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662559:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0cdc31a/0xce4472dd2237dc49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662567:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0cdc31a/0xce4472dd2237dc49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.662579:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.662582:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.662584:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930116.662585:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.662592:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a169fb7/0xce4472dd2237dc50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.662604:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a169fb7/0xce4472dd2237dc50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.662613:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a169fb7/0xce4472dd2237dc50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.662621:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a169fb7/0xce4472dd2237dc50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.662731:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788930116.663377:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.663384:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da797c0f/0xce4472dd2237dc57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.663394:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.663397:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.663402:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da797c0f/0xce4472dd2237dc57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.663412:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da797c0f/0xce4472dd2237dc57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.663420:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da797c0f/0xce4472dd2237dc57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.663434:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da797c0f/0xce4472dd2237dc57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.666784:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930116.666863:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a169fb7/0xce4472dd2237dc50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.666879:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930116.666885:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a169fb7/0xce4472dd2237dc50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.666896:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a169fb7/0xce4472dd2237dc50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.666920:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a169fb7/0xce4472dd2237dc50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.666928:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a169fb7/0xce4472dd2237dc50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.666961:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930116.667040:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da797c0f/0xce4472dd2237dc57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.667071:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930116.667075:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da797c0f/0xce4472dd2237dc57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.667082:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da797c0f/0xce4472dd2237dc57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.667093:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da797c0f/0xce4472dd2237dc57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.667101:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.667102:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.667104:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.667453:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788930116.667465:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da797c0f/0xce4472dd2237dc57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.668151:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788930116.668921:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.668933:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003738c306/0xce4472dd2237dc5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.668948:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.668953:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.668960:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003738c306/0xce4472dd2237dc5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.669112:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003738c306/0xce4472dd2237dc5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.669123:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003738c306/0xce4472dd2237dc5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.669132:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003738c306/0xce4472dd2237dc5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.669380:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930116.669388:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003738c306/0xce4472dd2237dc5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.669396:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930116.669400:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003738c306/0xce4472dd2237dc5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.669410:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003738c306/0xce4472dd2237dc5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.669428:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003738c306/0xce4472dd2237dc5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.669633:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788930116.669640:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003738c306/0xce4472dd2237dc5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.670060:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.670089:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.670092:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.670094:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788930116.670631:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.670640:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237dc65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.670653:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.670657:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.670663:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237dc65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.670687:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237dc65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.670697:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237dc65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.670705:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237dc65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.670760:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788930116.671374:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.671382:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d42f0a/0xce4472dd2237dc6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.671399:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.671402:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.671407:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d42f0a/0xce4472dd2237dc6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.671418:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3d42f0a/0xce4472dd2237dc6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.671426:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d42f0a/0xce4472dd2237dc6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.671434:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d42f0a/0xce4472dd2237dc6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.671537:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930116.671554:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237dc65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.671563:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930116.671568:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237dc65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.671577:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237dc65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.671594:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237dc65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.671602:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237dc65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.671624:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930116.671627:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3d42f0a/0xce4472dd2237dc6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.671632:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596e00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930116.671635:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d42f0a/0xce4472dd2237dc6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.671655:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d42f0a/0xce4472dd2237dc6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.671666:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3d42f0a/0xce4472dd2237dc6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.671674:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.671685:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.671687:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.671814:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788930116.671819:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d42f0a/0xce4472dd2237dc6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788930116.672463:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.672469:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078fd2297/0xce4472dd2237dc73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.672480:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.672483:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.672488:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078fd2297/0xce4472dd2237dc73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.672510:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078fd2297/0xce4472dd2237dc73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.672519:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078fd2297/0xce4472dd2237dc73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.672528:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078fd2297/0xce4472dd2237dc73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.672649:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930116.672657:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078fd2297/0xce4472dd2237dc73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.672667:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930116.672671:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078fd2297/0xce4472dd2237dc73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.672691:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078fd2297/0xce4472dd2237dc73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.672717:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078fd2297/0xce4472dd2237dc73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.672726:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.672727:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.672729:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.672832:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788930116.672838:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078fd2297/0xce4472dd2237dc73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788930116.673498:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.673506:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000af42aef/0xce4472dd2237dc7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.673518:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.673522:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.673527:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000af42aef/0xce4472dd2237dc7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.673539:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000af42aef/0xce4472dd2237dc7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.673689:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.673740:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000af42aef/0xce4472dd2237dc7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.673748:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000af42aef/0xce4472dd2237dc7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.673801:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788930116.674376:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.674383:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c8fd90e/0xce4472dd2237dc81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.674394:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.674397:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.674401:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c8fd90e/0xce4472dd2237dc81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.674412:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c8fd90e/0xce4472dd2237dc81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.674420:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c8fd90e/0xce4472dd2237dc81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.674427:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c8fd90e/0xce4472dd2237dc81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.674696:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788930116.674704:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000af42aef/0xce4472dd2237dc7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.674713:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930116.674718:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000af42aef/0xce4472dd2237dc7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.674728:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000af42aef/0xce4472dd2237dc7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.674745:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000af42aef/0xce4472dd2237dc7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.674752:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000af42aef/0xce4472dd2237dc7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.674774:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930116.674777:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c8fd90e/0xce4472dd2237dc81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.674797:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930116.674802:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c8fd90e/0xce4472dd2237dc81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.674811:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c8fd90e/0xce4472dd2237dc81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.674824:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c8fd90e/0xce4472dd2237dc81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930116.674831:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.674833:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930116.674835:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.674901:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788930116.674906:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c8fd90e/0xce4472dd2237dc81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788930116.675790:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788930116.675798:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237dc88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.675810:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=501s v=(0 0) 00010000:00010000:3.0:1788930116.675813:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930116.675818:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237dc88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.675830:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237dc88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.675839:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237dc88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930116.675847:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237dc88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.675906:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930116.675913:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237dc88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.675921:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930116.675925:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237dc88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.675933:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237dc88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.675946:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237dc88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930116.675954:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.675956:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930116.676039:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930116.676104:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788930116.676109:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d926504f/0xce4472dd2237dc88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788930116.676482:0:15108:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1788930116.676702:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14447:x1875828770183168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 100357us (101116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930116.676712:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788930116.676792:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14447:1875828770183168:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788930116.676808:0:14447:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788930116.676853:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14447:1875828770183296:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788930116.676895:0:14447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788930116.676899:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930116.677035:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9aebd480 going to sleep for 11 seconds 00000100:00100000:3.0:1788930116.677075:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770183296 00000100:00100000:3.0:1788930116.677083:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770183296 00000100:00100000:3.0:1788930116.677130:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788930116.677139:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14447:x1875828770183296:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788930116.677177:0:15107:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788930116.686372:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14447:x1875828770183296:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9227us (9470us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788930116.686387:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788930116.686436:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14447:1875828770183296:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788930116.686456:0:14447:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1788930116.956745:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788930117.276102:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788930117.276195:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1788930117.981086:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930118.619726:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788930118.619756:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770183424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788930118.619838:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930118.619920:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770183424 00000100:00100000:2.0:1788930118.619929:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770183424 00000100:00100000:2.0:1788930118.620001:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788930118.620011:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770183424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788930118.620045:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788930118.620091:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770183424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930118.620097:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788930118.620117:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788930118.620155:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770183424:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788930119.004105:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788930119.348531:0:16181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788930120.027686:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788930120.539990:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788930121.051347:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930121.692161:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770183552:0@lo:400:kworker.0 00000100:00100000:1.0:1788930121.692267:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930121.692311:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770184064:0@lo:400:kworker.0 00000100:00100000:1.0:1788930121.692338:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930121.692365:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788930121.692372:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770183680:0@lo:400:kworker.0 00000100:00100000:1.0:1788930121.692395:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930121.692411:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770184192:0@lo:400:kworker.0 00000100:00100000:1.0:1788930121.692430:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930121.693021:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770183808:0@lo:400:kworker.0 00000100:00100000:2.0:1788930121.693070:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930121.693097:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788930121.693106:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770183936:0@lo:400:kworker.0 00000100:00100000:2.0:1788930121.693131:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930121.693156:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770184320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788930121.693171:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770183680 00000100:00100000:3.0:1788930121.693180:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770183680 00000100:00100000:2.0:1788930121.693184:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930121.693220:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770183552 00000100:00100000:2.0:1788930121.693242:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770183552 00000100:00100000:3.0:1788930121.693263:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770183808 00000100:00100000:3.0:1788930121.693268:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770183808 00000100:00100000:2.0:1788930121.693283:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788930121.693297:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788930121.693298:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3310:x1875828770183552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930121.693309:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770183680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930121.693373:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770183680:12345-0@lo:400:kworker.0 Request processed in 67us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.693377:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3310:x1875828770183552:12345-0@lo:400:kworker.0 Request processed in 83us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930121.693386:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788930121.693390:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788930121.693408:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788930121.693423:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770183808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930121.693443:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770184064 00000100:00100000:2.0:1788930121.693449:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770184064 00000100:00100000:2.0:1788930121.693472:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770184192 00000100:00100000:2.0:1788930121.693476:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770184192 00000100:00100000:3.0:1788930121.693481:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770183808:12345-0@lo:400:kworker.0 Request processed in 58us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930121.693489:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788930121.693490:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770183936 00000100:00100000:2.0:1788930121.693494:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770183936 00000100:00080000:3.0:1788930121.693513:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788930121.693513:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788930121.693520:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788930121.693523:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770184064:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788930121.693524:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788930121.693558:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770184064:12345-0@lo:400:kworker.0 Request processed in 38us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.693565:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788930121.693578:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788930121.693595:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770184192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930121.693625:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770184192:12345-0@lo:400:kworker.0 Request processed in 42us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.693630:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788930121.693642:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788930121.693647:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770183936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930121.693672:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770183936:12345-0@lo:400:kworker.0 Request processed in 25us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.693677:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788930121.693695:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770184320 00000100:00100000:2.0:1788930121.693699:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770184320 00000100:00100000:2.0:1788930121.693729:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788930121.693743:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770184320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788930121.693770:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788930121.693806:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770184320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.693812:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788930121.693843:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788930121.693869:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770184320:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788930121.693884:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb5a3ca80 x1875828770183936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930121.693895:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770183936:0@lo:400:kworker.0 00000100:00100000:2.0:1788930121.693903:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770183808:0@lo:400:kworker.0 00010000:00080000:1.0:1788930121.694412:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb5a3fb80 x1875828770184192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930121.694424:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770184192:0@lo:400:kworker.0 00000100:00100000:1.0:1788930121.694437:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770183552:0@lo:400:kworker.0 00010000:00080000:1.0:1788930121.694448:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2eb5a3f800 x1875828770184064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930121.694759:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770184064:0@lo:400:kworker.0 00000100:00100000:1.0:1788930121.694789:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770183680:0@lo:400:kworker.0 00000100:00100000:1.0:1788930121.777392:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930121.777567:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747116416 00000100:00100000:3.0:1788930121.777578:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747116416 00000100:00100000:3.0:1788930121.777646:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:3.0:1788930121.777655:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2358:x1875828747116416:12345-192.168.204.40@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788930121.777687:0:14415:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ee1bfcc5-523d-42e7-aa5d-bab7d0395d67@192.168.204.40@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:3.0:1788930121.777719:0:14415:0:(genops.c:1384:class_connect()) connect: client ee1bfcc5-523d-42e7-aa5d-bab7d0395d67, cookie 0xce4472dd2237dc8f 00000100:00080000:3.0:1788930121.777882:0:14415:0:(import.c:65:import_set_state_nolock()) ffff8d2e86b9d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788930121.777971:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+5:2358:x1875828747116416:12345-192.168.204.40@tcp:250:mount.lustre.0 Request processed in 315us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930121.777980:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:3.0:1788930121.780744:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930121.780935:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747116544 00000100:00100000:1.0:1788930121.780946:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747116544 00000100:00100000:1.0:1788930121.781039:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:1.0:1788930121.781052:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5435850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+5:13760:x1875828747116544:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788930121.781076:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930121.781102:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237dc96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca71640210571 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930121.781138:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237dc96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210571 expref: 6 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930121.781152:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237dc96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210571 expref: 6 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930121.781162:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a74400, rc 0) 00000100:00100000:1.0:1788930121.781287:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5435850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+6:13760:x1875828747116544:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 237us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930121.781296:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:0.0:1788930121.784636:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930121.784797:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747116672 00000100:00100000:2.0:1788930121.784808:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747116672 00000100:00100000:2.0:1788930121.784866:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00100000:2.0:1788930121.784876:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+6:13760:x1875828747116672:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788930121.785169:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+6:13760:x1875828747116672:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 293us (546us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788930121.785178:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00100000:0.0:1788930121.789513:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930121.790265:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747116800 00000100:00100000:2.0:1788930121.790278:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747116800 00000100:00100000:2.0:1788930121.790345:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:2.0:1788930121.790356:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+6:13760:x1875828747116800:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788930121.790374:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930121.790394:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dc9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca71640210578 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930121.790450:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dc9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210578 expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930121.790461:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dc9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210578 expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930121.790470:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340000, rc 0) 00000100:00100000:2.0:1788930121.790593:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+7:13760:x1875828747116800:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 229us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.790600:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:3.0:1788930121.798535:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930121.798644:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747116928 00000100:00100000:1.0:1788930121.798657:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747116928 00000100:00100000:1.0:1788930121.798731:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:1.0:1788930121.798743:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+7:13760:x1875828747116928:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788930121.799368:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+8:13760:x1875828747116928:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 625us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930121.799378:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:1.0:1788930121.806354:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930121.807625:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747117056 00000100:00100000:0.0:1788930121.807641:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747117056 00000100:00100000:0.0:1788930121.807787:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00100000:0.0:1788930121.807800:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+8:13760:x1875828747117056:12345-192.168.204.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788930121.808664:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+8:13760:x1875828747117056:12345-192.168.204.40@tcp:503:mount.lustre.0 Request processed in 861us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930121.808675:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 82 00000100:00100000:0.0:1788930121.819483:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930121.820937:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747117184 00000100:00100000:1.0:1788930121.820954:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747117184 00000100:00100000:1.0:1788930121.821055:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:1.0:1788930121.821068:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+8:13779:x1875828747117184:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788930121.821573:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+8:13779:x1875828747117184:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 506us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930121.821592:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:1.0:1788930121.835216:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930121.835376:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747117312 00000100:00100000:2.0:1788930121.835389:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747117312 00000100:00100000:2.0:1788930121.835457:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:2.0:1788930121.835468:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+8:13779:x1875828747117312:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788930121.835807:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+8:13779:x1875828747117312:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 338us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.835815:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:2.0:1788930121.846589:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930121.847010:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747117440 00000100:00100000:0.0:1788930121.847036:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747117440 00000100:00100000:0.0:1788930121.847100:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 85 00000100:00100000:0.0:1788930121.847111:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+8:13760:x1875828747117440:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788930121.847132:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930121.847156:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b8e00/0xce4472dd2237dca4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca716402105a2 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930121.847188:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b8e00/0xce4472dd2237dca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402105a2 expref: 9 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930121.847200:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebe0b8e00/0xce4472dd2237dca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402105a2 expref: 9 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930121.847209:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8e00, rc 0) 00000100:00100000:0.0:1788930121.847304:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+9:13760:x1875828747117440:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 195us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930121.847312:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 85 00000100:00100000:0.0:1788930121.852054:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930121.852159:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747117568 00000100:00100000:1.0:1788930121.852170:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747117568 00000100:00100000:1.0:1788930121.852284:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 86 00000100:00100000:1.0:1788930121.852297:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+9:13760:x1875828747117568:12345-192.168.204.40@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788930121.852335:0:14417:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788930121.852360:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788930121.852363:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788930121.852366:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788930121.852369:0:14417:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788930121.855969:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+9:13760:x1875828747117568:12345-192.168.204.40@tcp:256:mount.lustre.0 Request processed in 3661us (3913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.855984:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 86 00000100:00100000:2.0:1788930121.859280:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930121.859371:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747117696 00000100:00100000:3.0:1788930121.859381:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747117696 00000100:00100000:3.0:1788930121.859443:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00100000:3.0:1788930121.859454:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+9:13760:x1875828747117696:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788930121.859469:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930121.859487:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc597600/0xce4472dd2237dcab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca716402105a9 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930121.859534:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc597600/0xce4472dd2237dcab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402105a9 expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930121.859546:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc597600/0xce4472dd2237dcab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402105a9 expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930121.859555:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597600, rc 0) 00000100:00100000:3.0:1788930121.859629:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+10:13760:x1875828747117696:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 176us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930121.859636:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00100000:0.0:1788930121.861461:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930121.861645:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747117824 00000100:00100000:2.0:1788930121.861655:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747117824 00000100:00100000:2.0:1788930121.861712:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 88 00000100:00100000:2.0:1788930121.861723:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+10:13760:x1875828747117824:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788930121.863129:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+10:13760:x1875828747117824:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 1397us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.863143:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 88 00000100:00100000:1.0:1788930121.865368:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930121.868131:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747117952 00000100:00100000:3.0:1788930121.868151:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747117952 00000100:00100000:3.0:1788930121.868291:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 89 00000100:00100000:3.0:1788930121.868303:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d843e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+10:13760:x1875828747117952:12345-192.168.204.40@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788930121.868577:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d843e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+10:13760:x1875828747117952:12345-192.168.204.40@tcp:503:mount.lustre.0 Request processed in 275us (3222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930121.868595:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 89 00000100:00100000:1.0:1788930121.875753:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930121.876471:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747118080 00000100:00100000:2.0:1788930121.876484:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747118080 00000100:00100000:2.0:1788930121.876545:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 90 00000100:00100000:2.0:1788930121.876555:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e864eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+10:13783:x1875828747118080:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788930121.877057:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e864eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+10:13783:x1875828747118080:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 501us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.877067:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 90 00000100:00100000:1.0:1788930121.884462:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930121.884661:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747118208 00000100:00100000:3.0:1788930121.884672:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747118208 00000100:00100000:3.0:1788930121.884726:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 91 00000100:00100000:3.0:1788930121.884734:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e864e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+10:13783:x1875828747118208:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788930121.885169:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e864e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+10:13783:x1875828747118208:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 434us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930121.885177:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 91 00000100:00100000:1.0:1788930121.890610:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930121.890886:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747118336 00000100:00100000:2.0:1788930121.890897:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747118336 00000100:00100000:2.0:1788930121.890947:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:2.0:1788930121.890956:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875828747118336:12345-192.168.204.40@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788930121.890986:0:14423:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0f2435a2-1693-4ef4-8931-95da2710cab3@192.168.204.40@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:2.0:1788930121.891049:0:14423:0:(genops.c:1384:class_connect()) connect: client 0f2435a2-1693-4ef4-8931-95da2710cab3, cookie 0xce4472dd2237dcb2 00000004:00100000:2.0:1788930121.891081:0:14423:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788930121.891087:0:14423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788930121.965879:0:14423:0:(import.c:65:import_set_state_nolock()) ffff8d2e86b9f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788930121.965991:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2358:x1875828747118336:12345-192.168.204.40@tcp:38:mount.lustre.0 Request processed in 75033us (75389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930121.966002:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:1.0:1788930121.969424:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930121.969833:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747118464 00000100:00100000:0.0:1788930121.969844:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747118464 00000100:00100000:0.0:1788930121.969923:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:0.0:1788930121.969942:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+6:0:x1875828747118464:12345-192.168.204.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788930121.969992:0:14424:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788930121.970130:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+6:0:x1875828747118464:12345-192.168.204.40@tcp:41:mount.lustre.0 Request processed in 190us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930121.970138:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:1.0:1788930121.970757:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930121.970853:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747118592 00000100:00100000:2.0:1788930121.970860:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747118592 00000100:00100000:2.0:1788930121.970892:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:2.0:1788930121.970900:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:13760:x1875828747118592:12345-192.168.204.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788930121.970916:0:14421:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788930121.970951:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:13760:x1875828747118592:12345-192.168.204.40@tcp:41:mount.lustre.0 Request processed in 53us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.970971:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00080000:3.0:1788930121.972437:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930121.976059:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930121.976135:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747118720 00000100:00100000:2.0:1788930121.976147:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747118720 00000100:00100000:2.0:1788930121.976214:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:2.0:1788930121.976243:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:13760:x1875828747118720:12345-192.168.204.40@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788930121.976818:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:13760:x1875828747118720:12345-192.168.204.40@tcp:40:mount.lustre.0 Request processed in 592us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.976826:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:3.0:1788930121.979786:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930121.979830:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930121.980010:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930121.980088:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747119104 00000100:00100000:1.0:1788930121.980098:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747119104 00000100:00100000:1.0:1788930121.980162:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:1.0:1788930121.980172:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:13760:x1875828747119104:12345-192.168.204.40@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788930121.980808:0:14425:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 544us 00000100:00100000:2.0:1788930121.990906:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747118848 00000100:00100000:2.0:1788930121.990924:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747118848 00000100:00100000:2.0:1788930121.990972:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747118976 00000100:00100000:2.0:1788930121.990975:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747118976 00000100:00100000:2.0:1788930121.990995:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:2.0:1788930121.991003:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875828747118848:12345-192.168.204.40@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788930121.991047:0:15106:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0f2435a2-1693-4ef4-8931-95da2710cab3@192.168.204.40@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:2.0:1788930121.991079:0:15106:0:(genops.c:1384:class_connect()) connect: client 0f2435a2-1693-4ef4-8931-95da2710cab3, cookie 0xce4472dd2237dcb9 00002000:00100000:2.0:1788930121.991090:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0f2435a2-1693-4ef4-8931-95da2710cab3/ffff8d2d849fc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788930121.991117:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788930121.991483:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788930121.991518:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d2d849fe800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788930121.991626:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2358:x1875828747118848:12345-192.168.204.40@tcp:8:mount.lustre.0 Request processed in 620us (11793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.991635:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:2.0:1788930121.991656:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:2.0:1788930121.991661:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875828747118976:12345-192.168.204.40@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788930121.991689:0:15106:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0f2435a2-1693-4ef4-8931-95da2710cab3@192.168.204.40@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:2.0:1788930121.991708:0:15106:0:(genops.c:1384:class_connect()) connect: client 0f2435a2-1693-4ef4-8931-95da2710cab3, cookie 0xce4472dd2237dcc0 00002000:00100000:2.0:1788930121.991713:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0f2435a2-1693-4ef4-8931-95da2710cab3/ffff8d2d849ff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788930121.991718:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788930121.991914:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788930121.991931:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d2d849fc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788930121.991963:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2358:x1875828747118976:12345-192.168.204.40@tcp:8:mount.lustre.0 Request processed in 301us (11954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930121.991971:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000004:00200000:3.0:1788930122.002823:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788930122.002977:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:13760:x1875828747119104:12345-192.168.204.40@tcp:33:mount.lustre.0 Request processed in 22801us (23195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930122.002991:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00010000:00010000:0.0:1788930122.075525:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930122.234983:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930122.235025:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747119232 00000100:00100000:0.0:1788930122.235034:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747119232 00000100:00100000:0.0:1788930122.235117:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:0.0:1788930122.235127:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+6:13804:x1875828747119232:12345-192.168.204.40@tcp:101:mkdir.0 00010000:00010000:0.0:1788930122.235149:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930122.235175:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237dcc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402105d3 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930122.235268:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237dcce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930122.235282:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237dcce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930122.235300:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237dcce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788930122.235336:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788930122.235340:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788930122.235376:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237dcce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930122.235428:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9000/0xce4472dd2237dcc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402105d3 expref: 8 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930122.235529:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237dcce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402105d3 expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930122.235538:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788930122.235541:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788930122.235544:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9e00, rc 0) 00000100:00100000:0.0:1788930122.235616:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+7:13804:x1875828747119232:12345-192.168.204.40@tcp:101:mkdir.0 Request processed in 489us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930122.235624:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000001:00100000:1.0:1788930122.273798:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f2435a2-1693-4ef4-8931-95da2710cab3 00010000:00010000:3.0:1788930123.099720:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930123.739554:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788930123.739584:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770184448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788930123.739668:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930123.740569:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770184448 00000100:00100000:2.0:1788930123.740582:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770184448 00000100:00100000:2.0:1788930123.740658:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788930123.740668:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770184448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788930123.740695:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788930123.744344:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770184448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3667us (4665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930123.744360:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788930123.744502:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770184448:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788930123.744823:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788930124.123547:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930124.413847:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930124.413953:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747119360 00000100:00100000:1.0:1788930124.413964:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747119360 00000100:00100000:1.0:1788930124.414048:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788930124.414067:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+7:13856:x1875828747119360:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:1.0:1788930124.414116:0:14421:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788930124.414562:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+7:13856:x1875828747119360:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 502us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930124.414572:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00080000:3.0:1788930124.415370:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788930124.440093:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930124.440257:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747119488 00000100:00100000:3.0:1788930124.440271:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747119488 00000100:00100000:3.0:1788930124.440365:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:3.0:1788930124.440377:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f2435a2-1693-4ef4-8931-95da2710cab3+6:13856:x1875828747119488:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:3.0:1788930124.440420:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788930124.440507:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f2435a2-1693-4ef4-8931-95da2710cab3+6:13856:x1875828747119488:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 132us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930124.440515:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00080000:2.0:1788930124.440673:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788930124.446788:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930124.446886:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747119616 00000100:00100000:3.0:1788930124.446898:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747119616 00000100:00100000:3.0:1788930124.446975:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:3.0:1788930124.446987:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f2435a2-1693-4ef4-8931-95da2710cab3+5:13856:x1875828747119616:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:3.0:1788930124.447029:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788930124.447129:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f2435a2-1693-4ef4-8931-95da2710cab3+5:13856:x1875828747119616:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 143us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930124.447136:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00080000:2.0:1788930124.447559:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788930124.723636:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930124.723805:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747119744 00000100:00100000:0.0:1788930124.723817:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747119744 00000100:00100000:0.0:1788930124.723879:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 92 00000100:00100000:0.0:1788930124.723889:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e864ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+10:13886:x1875828747119744:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788930124.723910:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930124.723929:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237dcd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca716402105da expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930124.723960:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237dcd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402105da expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930124.724252:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237dcd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402105da expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930124.724262:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9000, rc 0) 00000100:00100000:0.0:1788930124.724458:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e864ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:13886:x1875828747119744:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 570us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930124.724466:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 92 00000100:00100000:1.0:1788930124.729917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930124.730176:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747119872 00000100:00100000:2.0:1788930124.730188:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747119872 00000100:00100000:2.0:1788930124.730501:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 93 00000100:00100000:2.0:1788930124.730515:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e864e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:13886:x1875828747119872:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788930124.730863:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e864e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:13886:x1875828747119872:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 350us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930124.732767:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 93 00000100:00100000:2.0:1788930124.733788:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930124.735417:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747120000 00000100:00100000:0.0:1788930124.735432:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747120000 00000100:00100000:0.0:1788930124.735503:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 94 00000100:00100000:0.0:1788930124.735514:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e864e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:13886:x1875828747120000:12345-192.168.204.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788930124.735870:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e864e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:13886:x1875828747120000:12345-192.168.204.40@tcp:503:mount.lustre.0 Request processed in 355us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930124.735878:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 94 00000100:00100000:1.0:1788930124.742844:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930124.742956:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747120128 00000100:00100000:2.0:1788930124.742968:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747120128 00000100:00100000:2.0:1788930124.743032:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 95 00000100:00100000:2.0:1788930124.743043:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:13894:x1875828747120128:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788930124.743464:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:13894:x1875828747120128:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 421us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930124.743473:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 95 00000100:00100000:1.0:1788930124.776344:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930124.776611:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747120256 00000100:00100000:3.0:1788930124.776622:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747120256 00000100:00100000:3.0:1788930124.776684:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 96 00000100:00100000:3.0:1788930124.776695:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:13894:x1875828747120256:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788930124.777003:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:13894:x1875828747120256:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 309us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930124.777013:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 96 00000100:00100000:3.0:1788930124.794688:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930124.795008:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747120384 00000100:00100000:0.0:1788930124.795020:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747120384 00000100:00100000:0.0:1788930124.795085:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 97 00000100:00100000:0.0:1788930124.795097:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:13886:x1875828747120384:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788930124.795114:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930124.795141:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b9c00/0xce4472dd2237dcdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca71640210604 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930124.795170:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b9c00/0xce4472dd2237dcdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210604 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930124.795182:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebe0b9c00/0xce4472dd2237dcdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210604 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930124.795204:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9c00, rc 0) 00000100:00100000:0.0:1788930124.795288:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+12:13886:x1875828747120384:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 192us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930124.795296:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 97 00000100:00100000:1.0:1788930124.807213:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930124.807388:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747120512 00000100:00100000:2.0:1788930124.807401:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747120512 00000100:00100000:2.0:1788930124.807461:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 98 00000100:00100000:2.0:1788930124.807471:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+12:13886:x1875828747120512:12345-192.168.204.40@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788930124.807502:0:14417:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788930124.807539:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788930124.807543:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788930124.807546:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788930124.807548:0:14417:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788930124.811980:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+12:13886:x1875828747120512:12345-192.168.204.40@tcp:256:mount.lustre.0 Request processed in 4487us (4754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930124.812006:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 98 00000100:00100000:3.0:1788930124.828584:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930124.829130:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747120640 00000100:00100000:2.0:1788930124.829140:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747120640 00000100:00100000:2.0:1788930124.829198:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 99 00000100:00100000:2.0:1788930124.829215:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+12:13886:x1875828747120640:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788930124.829267:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930124.829284:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2eb5341200/0xce4472dd2237dce3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca7164021060b expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930124.829315:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2eb5341200/0xce4472dd2237dce3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021060b expref: 13 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930124.829326:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2eb5341200/0xce4472dd2237dce3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021060b expref: 13 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930124.829335:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341200, rc 0) 00000100:00100000:2.0:1788930124.829407:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13886:x1875828747120640:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 200us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930124.829415:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 99 00000100:00100000:1.0:1788930124.832206:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930124.832922:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747120768 00000100:00100000:2.0:1788930124.832934:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747120768 00000100:00100000:2.0:1788930124.833009:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 100 00000100:00100000:2.0:1788930124.833019:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13886:x1875828747120768:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788930124.833354:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13886:x1875828747120768:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 335us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930124.833363:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 100 00000100:00100000:1.0:1788930124.838594:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930124.838804:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747120896 00000100:00100000:0.0:1788930124.838815:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747120896 00000100:00100000:0.0:1788930124.838887:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 101 00000100:00100000:0.0:1788930124.838907:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13886:x1875828747120896:12345-192.168.204.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788930124.839772:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13886:x1875828747120896:12345-192.168.204.40@tcp:503:mount.lustre.0 Request processed in 870us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930124.839781:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 101 00000100:00100000:0.0:1788930124.845879:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930124.846295:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747121024 00000100:00100000:3.0:1788930124.846305:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747121024 00000100:00100000:3.0:1788930124.846352:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 102 00000100:00100000:3.0:1788930124.846361:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13898:x1875828747121024:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788930124.859446:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13898:x1875828747121024:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 13071us (13564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930124.859464:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 102 00000100:00100000:1.0:1788930124.868325:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930124.868551:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747121152 00000100:00100000:2.0:1788930124.868562:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747121152 00000100:00100000:2.0:1788930124.868618:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 103 00000100:00100000:2.0:1788930124.868643:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb33adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13898:x1875828747121152:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788930124.868907:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb33adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13898:x1875828747121152:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 259us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930124.868916:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 103 00000100:00100000:1.0:1788930124.874021:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930124.874210:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747121280 00000100:00100000:0.0:1788930124.874260:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747121280 00000100:00100000:0.0:1788930124.874323:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:0.0:1788930124.874332:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1875828747121280:12345-192.168.204.40@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788930124.874369:0:14424:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 6f457351-9f47-4d69-8728-cf079fbb04a5@192.168.204.40@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1788930124.874428:0:14424:0:(genops.c:1384:class_connect()) connect: client 6f457351-9f47-4d69-8728-cf079fbb04a5, cookie 0xce4472dd2237dcea 00000004:00100000:0.0:1788930124.874465:0:14424:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788930124.874606:0:14424:0:(import.c:65:import_set_state_nolock()) ffff8d2ebefd7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788930124.874671:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2358:x1875828747121280:12345-192.168.204.40@tcp:38:mount.lustre.0 Request processed in 339us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930124.874680:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:3.0:1788930124.883288:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930124.883479:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747121408 00000100:00100000:1.0:1788930124.883495:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747121408 00000100:00100000:1.0:1788930124.883612:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:1.0:1788930124.883624:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+6:0:x1875828747121408:12345-192.168.204.40@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788930124.883668:0:14421:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1788930124.883804:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788930124.885761:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+6:0:x1875828747121408:12345-192.168.204.40@tcp:41:mount.lustre.0 Request processed in 2125us (2468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930124.885777:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:0.0:1788930124.901915:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930124.902139:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747121536 00000100:00100000:2.0:1788930124.902149:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747121536 00000100:00100000:2.0:1788930124.902204:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:2.0:1788930124.902221:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+6:13886:x1875828747121536:12345-192.168.204.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788930124.902268:0:14423:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788930124.902337:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+6:13886:x1875828747121536:12345-192.168.204.40@tcp:41:mount.lustre.0 Request processed in 117us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930124.902344:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:1.0:1788930124.909171:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930124.912424:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747121664 00000100:00100000:2.0:1788930124.912442:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747121664 00000100:00100000:2.0:1788930124.912543:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:2.0:1788930124.912556:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+6:13886:x1875828747121664:12345-192.168.204.40@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788930124.912673:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+6:13886:x1875828747121664:12345-192.168.204.40@tcp:40:mount.lustre.0 Request processed in 120us (3513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930124.912681:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:3.0:1788930124.942803:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930124.942850:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930124.942892:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930124.943020:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747121792 00000100:00100000:0.0:1788930124.943035:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747121792 00000100:00100000:0.0:1788930124.943081:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747121920 00000100:00100000:0.0:1788930124.943085:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747121920 00000100:00100000:0.0:1788930124.943100:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:0.0:1788930124.943110:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875828747121792:12345-192.168.204.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788930124.943148:0:15107:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6f457351-9f47-4d69-8728-cf079fbb04a5@192.168.204.40@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1788930124.943184:0:15107:0:(genops.c:1384:class_connect()) connect: client 6f457351-9f47-4d69-8728-cf079fbb04a5, cookie 0xce4472dd2237dcf1 00002000:00100000:0.0:1788930124.943199:0:15107:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6f457351-9f47-4d69-8728-cf079fbb04a5/ffff8d2ebefd1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788930124.943212:0:15107:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788930124.943366:0:15107:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788930124.943415:0:15107:0:(import.c:65:import_set_state_nolock()) ffff8d2ebefd4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788930124.943480:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2358:x1875828747121792:12345-192.168.204.40@tcp:8:mount.lustre.0 Request processed in 371us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930124.943488:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:0.0:1788930124.943696:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:0.0:1788930124.943702:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875828747121920:12345-192.168.204.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788930124.943719:0:15107:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6f457351-9f47-4d69-8728-cf079fbb04a5@192.168.204.40@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1788930124.943736:0:15107:0:(genops.c:1384:class_connect()) connect: client 6f457351-9f47-4d69-8728-cf079fbb04a5, cookie 0xce4472dd2237dcf8 00002000:00100000:0.0:1788930124.943742:0:15107:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6f457351-9f47-4d69-8728-cf079fbb04a5/ffff8d2ebefd0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788930124.943748:0:15107:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788930124.943947:0:15107:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788930124.943967:0:15107:0:(import.c:65:import_set_state_nolock()) ffff8d2ebefd2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788930124.943996:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2358:x1875828747121920:12345-192.168.204.40@tcp:8:mount.lustre.0 Request processed in 293us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930124.944021:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:1.0:1788930124.945589:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747122048 00000100:00100000:1.0:1788930124.945602:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747122048 00000100:00100000:1.0:1788930124.945687:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:1.0:1788930124.945700:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+6:13886:x1875828747122048:12345-192.168.204.40@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788930124.945788:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788930124.945868:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+6:13886:x1875828747122048:12345-192.168.204.40@tcp:33:mount.lustre.0 Request processed in 170us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930124.945875:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1 00010000:00010000:3.0:1788930125.147388:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930125.272687:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930125.272941:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747122176 00000100:00100000:0.0:1788930125.272953:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747122176 00000100:00100000:0.0:1788930125.273028:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:0.0:1788930125.273040:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+6:13919:x1875828747122176:12345-192.168.204.40@tcp:101:mkdir.0 00010000:00010000:0.0:1788930125.273061:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930125.273095:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237dcff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210635 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930125.273168:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237dd06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930125.273185:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237dd06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930125.273198:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237dd06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788930125.273271:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788930125.273276:0:14424:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788930125.273296:0:14424:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237dd06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930125.273326:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8c00/0xce4472dd2237dcff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210635 expref: 8 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930125.273345:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237dd06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210635 expref: 7 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930125.273375:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:0.0:1788930125.273387:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788930125.273392:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8400, rc 0) 00000100:00100000:0.0:1788930125.273468:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+7:13919:x1875828747122176:12345-192.168.204.40@tcp:101:mkdir.0 Request processed in 430us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930125.273475:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00000001:00100000:0.0:1788930125.913074:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6f457351-9f47-4d69-8728-cf079fbb04a5 00000001:00100000:0.0:1788930125.914214:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0f2435a2-1693-4ef4-8931-95da2710cab3 00010000:00010000:0.0:1788930126.171544:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930126.813057:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb5a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770184576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788930126.813146:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930126.813257:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770184576 00000100:00100000:1.0:1788930126.813271:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770184576 00000100:00100000:1.0:1788930126.813340:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788930126.814172:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788930126.814775:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770184576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788930126.814826:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788930126.815001:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770184576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1652us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930126.815010:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788930126.815814:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb5a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770184576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788930126.816481:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770184960:0@lo:400:kworker.0 00000100:00100000:1.0:1788930126.816555:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930126.816599:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788930126.816605:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770184832:0@lo:400:kworker.0 00000100:00100000:1.0:1788930126.816631:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930126.816714:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770184960 00000100:00100000:3.0:1788930126.816723:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770184960 00000100:00100000:3.0:1788930126.816784:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788930126.816793:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770184960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930126.816855:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770184960:12345-0@lo:400:kworker.0 Request processed in 63us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930126.816862:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788930126.817198:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770185088:0@lo:400:kworker.0 00000100:00100000:0.0:1788930126.817243:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930126.817266:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788930126.817272:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770184704:0@lo:400:kworker.0 00000100:00100000:0.0:1788930126.817303:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930126.817329:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770185216:0@lo:400:kworker.0 00000100:00100000:0.0:1788930126.817349:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930126.817792:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770184960:0@lo:400:kworker.0 00000100:00100000:1.0:1788930126.817819:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770184832 00000100:00100000:1.0:1788930126.817824:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770184832 00000100:00100000:3.0:1788930126.818613:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770185088 00000100:00100000:3.0:1788930126.818620:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770185088 00000100:00100000:0.0:1788930126.818793:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770184704 00000100:00100000:0.0:1788930126.818798:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770184704 00000100:00100000:1.0:1788930126.818928:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788930126.818947:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770184832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930126.819019:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770184832:12345-0@lo:400:kworker.0 Request processed in 83us (2387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930126.819026:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788930126.819070:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770184832:0@lo:400:kworker.0 00000100:00100000:0.0:1788930126.820040:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788930126.820058:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb33ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3310:x1875828770184704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930126.820125:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb33ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3310:x1875828770184704:12345-0@lo:400:kworker.0 Request processed in 75us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930126.820152:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788930126.820201:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770185216 00000100:00100000:0.0:1788930126.820207:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770185216 00000100:00100000:3.0:1788930126.822877:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788930126.822892:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770185088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930126.823008:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770185088:12345-0@lo:400:kworker.0 Request processed in 120us (5763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930126.823015:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788930126.823555:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788930126.823565:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788930126.823576:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770184704:0@lo:400:kworker.0 00000100:00100000:3.0:1788930126.823599:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770185088:0@lo:400:kworker.0 00000100:00100000:0.0:1788930126.826612:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788930126.826626:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770185216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930126.826741:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770185216:12345-0@lo:400:kworker.0 Request processed in 118us (9390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930126.826748:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788930126.826783:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770185216:0@lo:400:kworker.0 00010000:00010000:3.0:1788930127.195413:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788930127.381237:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6f457351-9f47-4d69-8728-cf079fbb04a5 00000001:00100000:0.0:1788930127.381255:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0f2435a2-1693-4ef4-8931-95da2710cab3 00000001:00100000:1.0:1788930127.381561:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6f457351-9f47-4d69-8728-cf079fbb04a5 00010000:00010000:0.0:1788930128.219979:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930128.859592:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770185344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788930128.859672:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930128.859782:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770185344 00000100:00100000:1.0:1788930128.859792:0:15109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770185344 00000100:00100000:1.0:1788930128.859882:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788930128.859903:0:15109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770185344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788930128.859943:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788930128.869497:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788930128.879629:0:15109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770185344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 19651us (19870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930128.879646:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788930128.881320:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770185344:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788930129.118847:0:16388:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788930129.244335:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930130.274405:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930130.403676:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930130.403719:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930130.403747:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930130.403766:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930130.403785:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930130.403800:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930130.403822:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930130.403847:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747122560 00000100:00100000:1.0:1788930130.403858:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747122560 00000100:00100000:1.0:1788930130.403922:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747123072 00000100:00100000:1.0:1788930130.403926:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747123072 00000100:00100000:1.0:1788930130.403940:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747122688 00000100:00100000:1.0:1788930130.403943:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747122688 00000100:00100000:1.0:1788930130.403962:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747122944 00000100:00100000:1.0:1788930130.403964:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747122944 00000100:00100000:1.0:1788930130.403980:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:1.0:1788930130.403991:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2362:x1875828747122560:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930130.404072:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2362:x1875828747122560:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 83us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930130.404081:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:1.0:1788930130.404104:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:1.0:1788930130.404112:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2362:x1875828747123072:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930130.404136:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2362:x1875828747123072:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930130.404141:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:1.0:1788930130.404166:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:1.0:1788930130.404174:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2362:x1875828747122688:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930130.404218:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2362:x1875828747122688:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 46us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930130.404250:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:1.0:1788930130.404263:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788930130.404270:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2362:x1875828747122944:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930130.404292:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2362:x1875828747122944:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 24us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930130.404298:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:3.0:1788930130.406360:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747122816 00000100:00100000:3.0:1788930130.406375:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747122816 00000100:00100000:3.0:1788930130.406440:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747122432 00000100:00100000:3.0:1788930130.406443:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747122432 00000100:00100000:3.0:1788930130.406473:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:3.0:1788930130.406483:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2362:x1875828747122816:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930130.406568:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2362:x1875828747122816:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 85us (2818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930130.406575:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:3.0:1788930130.406602:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:3.0:1788930130.406610:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2362:x1875828747122432:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930130.406636:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2362:x1875828747122432:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (2850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930130.406642:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:2.0:1788930130.407461:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747122304 00000100:00100000:2.0:1788930130.407470:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747122304 00000100:00100000:2.0:1788930130.407524:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 105 00000100:00100000:2.0:1788930130.407543:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb33ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2362:x1875828747122304:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930130.407591:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb33ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2362:x1875828747122304:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 50us (3924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930130.407597:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 105 00000100:00080000:2.0:1788930130.408965:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788930130.408973:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788930130.408976:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788930130.779884:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788930131.299473:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930131.933215:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770185472:0@lo:400:kworker.0 00000100:00100000:2.0:1788930131.933319:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930131.933473:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770185600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788930131.933521:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930131.933569:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770185600 00000100:00100000:3.0:1788930131.933577:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770185600 00000100:00100000:3.0:1788930131.933640:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788930131.933650:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770185600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788930131.933690:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788930131.933737:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770185600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930131.933744:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788930131.933794:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770185600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788930131.934817:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770185856:0@lo:400:kworker.0 00000100:00100000:3.0:1788930131.934867:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930131.934911:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770185856 00000100:00100000:3.0:1788930131.934917:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770185856 00000100:00100000:3.0:1788930131.934953:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788930131.934960:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770185856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930131.935003:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770185856:12345-0@lo:400:kworker.0 Request processed in 43us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930131.935026:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788930131.935052:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770185728:0@lo:400:kworker.0 00000100:00100000:3.0:1788930131.935081:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930131.935110:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770185728 00000100:00100000:3.0:1788930131.935114:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770185728 00000100:00100000:3.0:1788930131.935149:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788930131.935155:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770185728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930131.935189:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770185728:12345-0@lo:400:kworker.0 Request processed in 34us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930131.935195:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788930131.935246:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770185728:0@lo:400:kworker.0 00000100:00100000:3.0:1788930131.935274:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770185856:0@lo:400:kworker.0 00000100:00100000:2.0:1788930131.940503:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770185472 00000100:00100000:2.0:1788930131.940519:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770185472 00000100:00100000:2.0:1788930131.940585:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788930131.940596:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3309:x1875828770185472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930131.940688:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3309:x1875828770185472:12345-0@lo:400:kworker.0 Request processed in 93us (7369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930131.940696:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788930131.940735:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788930131.940741:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788930131.940772:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770185472:0@lo:400:kworker.0 00000100:00100000:3.0:1788930131.942928:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788930131.942956:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770186112:0@lo:400:kworker.0 00000100:00100000:3.0:1788930131.943042:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930131.943110:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770186112 00000100:00100000:3.0:1788930131.943119:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770186112 00000100:00100000:3.0:1788930131.943173:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788930131.943182:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770186112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930131.943247:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770186112:12345-0@lo:400:kworker.0 Request processed in 66us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930131.943254:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788930131.943277:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788930131.943286:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770185984:0@lo:400:kworker.0 00000100:00100000:3.0:1788930131.943309:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930131.943351:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770185984 00000100:00100000:3.0:1788930131.943355:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770185984 00000100:00100000:3.0:1788930131.943383:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788930131.943403:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770185984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930131.943437:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770185984:12345-0@lo:400:kworker.0 Request processed in 48us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930131.943443:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788930131.943496:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770185984:0@lo:400:kworker.0 00000100:00100000:3.0:1788930131.943527:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770186112:0@lo:400:kworker.0 00000100:00080000:2.0:1788930131.943677:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788930132.330539:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930133.339582:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788930133.411538:0:16535:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd843829f0 20000000:00000080:0.0:1788930133.411558:0:16535:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2d86746800 uarg=0000000000000000 20000000:01000000:0.0:1788930133.411603:0:16535:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788930133.411610:0:16535:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788930133.411615:0:16535:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788930133.412724:0:16536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788930133.412901:0:16535:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788930133.419575:0:16535:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788930133.419713:0:16535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.419735:0:16535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237da04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237d9fd expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.419764:0:16535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d8677da00/0xce4472dd2237da51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237da4a expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.419771:0:16535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237db85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237db7e expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.419781:0:16535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ebc597600/0xce4472dd2237dcab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402105a9 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.419789:0:16535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2eb5341200/0xce4472dd2237dce3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021060b expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.419798:0:16535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.419952:0:16535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2eb5341200/0xce4472dd2237dce3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021060b expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.419970:0:16535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2eb5341200/0xce4472dd2237dce3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021060b expref: 12 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930133.419987:0:16535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84379880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1875828770186240:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788930133.420151:0:16535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ebc597600/0xce4472dd2237dcab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402105a9 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.420161:0:16535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ebc597600/0xce4472dd2237dcab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402105a9 expref: 12 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930133.420170:0:16535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1875828770186368:192.168.204.40@tcp:104: 00010000:00010000:0.0:1788930133.420215:0:16535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237db85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237db7e expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.421204:0:16535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237db85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237db7e expref: 18 pid: 14417 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930133.421299:0:16535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d84378a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1875828770186496:0@lo:104: 00000100:00100000:0.0:1788930133.421348:0:16535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788930133.421409:0:16535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d8677da00/0xce4472dd2237da51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237da4a expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.421418:0:16535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2d8677da00/0xce4472dd2237da51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237da4a expref: 18 pid: 14416 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930133.421427:0:16535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1875828770186624:0@lo:104: 00000100:00100000:0.0:1788930133.421449:0:16535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930133.421557:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770186496 00000100:00100000:0.0:1788930133.421565:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770186496 00000100:00100000:0.0:1788930133.421604:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770186624 00000100:00100000:0.0:1788930133.421607:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770186624 00000100:00100000:0.0:1788930133.421624:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788930133.421632:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+4:16535:x1875828770186496:12345-0@lo:104: 00010000:00010000:0.0:1788930133.421645:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237db85 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.421692:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788930133.422187:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+4:16535:x1875828770186496:12345-0@lo:104: Request processed in 555us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930133.422195:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788930133.422312:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788930133.422320:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+3:16535:x1875828770186624:12345-0@lo:104: 00010000:00010000:0.0:1788930133.422330:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237da51 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.422384:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788930133.422390:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+3:16535:x1875828770186624:12345-0@lo:104: Request processed in 71us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930133.422395:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788930133.422415:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788930133.422421:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237db85 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.422429:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9400 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788930133.422438:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237db85 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.422446:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237db85 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788930133.422453:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237db85 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930133.422460:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788930133.422506:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237db85 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.422512:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788930133.422531:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237db85 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.422548:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9400/0xce4472dd2237db7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237db85 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.422565:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930133.422568:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237da51 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.422574:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9800 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788930133.422576:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237da51 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.422583:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237da51 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788930133.422588:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237da51 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930133.422594:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788930133.422607:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237da51 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.422612:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788930133.422627:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237da51 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.422633:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9800/0xce4472dd2237da4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237da51 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.422642:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930133.422649:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930133.422650:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930133.422685:0:16535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237da04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237d9fd expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930133.422707:0:16535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237da04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237d9fd expref: 18 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930133.422719:0:16535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1875828770187008:0@lo:104: 00000100:00100000:0.0:1788930133.422754:0:16535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930133.422775:0:16535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e22c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788930133.422800:0:16535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84378a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1875828770186496:0@lo:104: 00000100:00100000:0.0:1788930133.422808:0:16535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1875828770186624:0@lo:104: 00000100:00100000:0.0:1788930133.424939:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3311:1875828770186752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788930133.425017:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788930133.425097:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930133.426189:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d867c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770186880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788930133.426648:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930133.427126:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788930133.427145:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770187008 00000100:00100000:2.0:1788930133.427154:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770187008 00000100:00100000:0.0:1788930133.427417:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930133.427500:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788930133.427512:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb7129850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+3:16535:x1875828770187008:12345-0@lo:104: 00000100:00100000:0.0:1788930133.427515:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00010000:3.0:1788930133.427529:0:14406:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237da04 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930133.427555:0:16535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d84379880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1875828770186240:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788930133.427566:0:16535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d8437b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1875828770186368:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788930133.427574:0:16535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16535:1875828770187008:0@lo:104: 00010000:00010000:3.0:1788930133.427581:0:14406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788930133.427586:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb7129850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+3:16535:x1875828770187008:12345-0@lo:104: Request processed in 78us (4832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930133.427591:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788930133.427609:0:16535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.427631:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930133.427637:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237da04 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.427645:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341000 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:3.0:1788930133.427648:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237da04 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.427670:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237da04 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788930133.427677:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237da04 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930133.427683:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788930133.428074:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770186752 00000100:00100000:2.0:1788930133.428081:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770186752 00010000:00010000:2.0:1788930133.428113:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237db85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237db7e expref: 19 pid: 14417 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930133.428129:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770186880 00000100:00100000:2.0:1788930133.428132:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770186880 00010000:00010000:2.0:1788930133.428142:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d8677da00/0xce4472dd2237da51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237da4a expref: 20 pid: 14416 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930133.428152:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747123328 00000100:00100000:2.0:1788930133.428155:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747123328 00010000:00010000:2.0:1788930133.428167:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ebc597600/0xce4472dd2237dcab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402105a9 expref: 13 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930133.428177:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747123200 00000100:00100000:2.0:1788930133.428179:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747123200 00000100:00100000:1.0:1788930133.428378:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788930133.428398:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+20:3311:x1875828770186752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930133.428411:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930133.428417:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237db85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237db7e expref: 20 pid: 14417 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930133.428428:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237db85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237db7e expref: 20 pid: 14417 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930133.428447:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d8677ca00/0xce4472dd2237db85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237db7e expref: 20 pid: 14417 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930133.428461:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930133.428508:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3311:x1875828770186752:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (3492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930133.428514:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788930133.428530:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788930133.428537:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:3308:x1875828770186880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930133.428556:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930133.428561:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d8677da00/0xce4472dd2237da51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237da4a expref: 18 pid: 14416 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930133.428569:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d8677da00/0xce4472dd2237da51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237da4a expref: 18 pid: 14416 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930133.428578:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d8677da00/0xce4472dd2237da51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237da4a expref: 18 pid: 14416 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930133.428586:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930133.428616:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:3308:x1875828770186880:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930133.428622:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788930133.428636:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:1.0:1788930133.428644:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9aee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+14:2362:x1875828747123328:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788930133.428652:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930133.428656:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ebc597600/0xce4472dd2237dcab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402105a9 expref: 14 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930133.428665:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ebc597600/0xce4472dd2237dcab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402105a9 expref: 14 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930133.428675:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc597600/0xce4472dd2237dcab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402105a9 expref: 14 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930133.428685:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930133.428727:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9aee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2362:x1875828747123328:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 84us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930133.428742:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00010000:00010000:2.0:1788930133.428984:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2eb5341200/0xce4472dd2237dce3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021060b expref: 12 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930133.429009:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:2.0:1788930133.429017:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+12:2362:x1875828747123200:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788930133.429026:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788930133.429030:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2eb5341200/0xce4472dd2237dce3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021060b expref: 12 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930133.429040:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2eb5341200/0xce4472dd2237dce3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021060b expref: 12 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930133.429050:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5341200/0xce4472dd2237dce3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021060b expref: 12 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930133.429059:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788930133.429090:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:2362:x1875828747123200:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 74us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930133.429096:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:1.0:1788930133.430653:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770186880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788930133.430707:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d867c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3311:1875828770186752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788930133.431658:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237da04 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.431671:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788930133.431707:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237da04 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.431715:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341000/0xce4472dd2237d9fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237da04 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.431734:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930133.431737:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930133.431739:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930133.431785:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788930133.431801:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770187136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788930133.431879:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930133.432024:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770187136 00000100:00100000:3.0:1788930133.432032:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770187136 00010000:00010000:3.0:1788930133.432060:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237da04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237d9fd expref: 17 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930133.432095:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788930133.432104:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:3308:x1875828770187136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788930133.432115:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788930133.432119:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237da04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237d9fd expref: 17 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.432143:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237da04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237d9fd expref: 17 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.432158:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2152a00/0xce4472dd2237da04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237d9fd expref: 17 pid: 14415 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.432173:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.432181:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.432194:0:14408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.432200:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.432218:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.432257:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.432263:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788930133.432267:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.432274:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.432432:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930133.432443:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788930133.432479:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:3308:x1875828770187136:12345-0@lo:103:ldlm_bl.0 Request processed in 376us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930133.432487:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788930133.432736:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770187136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930133.432782:0:16535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930133.432790:0:16535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930133.432796:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237dd0d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930133.980012:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770187264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788930133.980087:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930133.980253:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770187264 00000100:00100000:2.0:1788930133.980264:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770187264 00000100:00100000:2.0:1788930133.980340:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788930133.980363:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770187264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788930133.980399:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788930133.980446:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770187264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930133.980453:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788930133.980806:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788930133.980861:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770187264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788930134.370435:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788930135.259901:0:14419:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788930135.259911:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2d84872800 from 10 10000000:01000000:3.0:1788930135.259918:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788930135.259973:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.259985:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.259995:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930135.260022:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770187392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788930135.260098:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930135.260160:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788930135.260455:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770187392 00000100:00100000:0.0:1788930135.260465:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770187392 00000100:00100000:0.0:1788930135.260522:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788930135.260541:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:14419:x1875828770187392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788930135.260556:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930135.260570:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b9800/0xce4472dd2237dd1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237dd14 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930135.260593:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b9800/0xce4472dd2237dd1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237dd14 expref: 17 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930135.260603:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebe0b9800/0xce4472dd2237dd1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237dd14 expref: 17 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930135.260612:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9800, rc 0) 00000100:00100000:0.0:1788930135.260666:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:14419:x1875828770187392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930135.260673:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788930135.261364:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770187392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788930135.261388:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930135.261398:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930135.261475:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770187520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788930135.261516:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930135.261582:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788930135.261788:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770187520 00000100:00100000:3.0:1788930135.261797:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770187520 00000100:00100000:3.0:1788930135.261831:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788930135.261839:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:14419:x1875828770187520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788930135.262127:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:14419:x1875828770187520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930135.262145:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788930135.262689:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930135.262715:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747123456 00000100:00100000:3.0:1788930135.262721:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747123456 00000100:00100000:3.0:1788930135.262751:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 109 00000100:00100000:3.0:1788930135.262759:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:13774:x1875828747123456:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788930135.262866:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930135.262890:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237dd22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca7164021063c expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.262919:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237dd22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021063c expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.262931:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237dd22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021063c expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.262940:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596600, rc 0) 00000100:00100000:3.0:1788930135.262985:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+12:13774:x1875828747123456:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 226us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930135.262991:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 109 00000100:00100000:1.0:1788930135.263261:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770187520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788930135.263461:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770187648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788930135.263522:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930135.263564:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788930135.263700:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770187648 00000100:00100000:0.0:1788930135.263707:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770187648 00000100:00100000:0.0:1788930135.263749:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788930135.263757:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:14419:x1875828770187648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788930135.263954:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:14419:x1875828770187648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930135.263961:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788930135.264109:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770187648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788930135.264828:0:16607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788930135.264897:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788930135.264925:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788930135.264936:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930135.264947:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930135.264957:0:14419:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788930135.264959:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2e881f6000 from 10 10000000:01000000:0.0:1788930135.264962:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788930135.264995:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930135.265003:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930135.265012:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930135.265038:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770187776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788930135.265082:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930135.265111:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e8640c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788930135.265126:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770187776 00000100:00100000:0.0:1788930135.265130:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770187776 00000100:00100000:0.0:1788930135.265159:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788930135.265166:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:14419:x1875828770187776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788930135.265177:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930135.265199:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237dd30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237dd29 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930135.265219:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237dd30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237dd29 expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930135.265255:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237dd30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237dd29 expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930135.265263:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8200, rc 0) 00000100:00100000:0.0:1788930135.265294:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:14419:x1875828770187776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930135.265301:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788930135.265348:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770187776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788930135.265361:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930135.265369:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930135.265411:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770187904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788930135.265433:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930135.265445:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86352e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788930135.265455:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770187904 00000100:00100000:0.0:1788930135.265458:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770187904 00000100:00100000:0.0:1788930135.265476:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788930135.265481:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:14419:x1875828770187904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788930135.265692:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:14419:x1875828770187904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930135.265704:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788930135.265731:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770187904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788930135.265757:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebc828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770188032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788930135.265793:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930135.265806:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86352e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788930135.265816:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770188032 00000100:00100000:0.0:1788930135.265819:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770188032 00000100:00100000:0.0:1788930135.265837:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788930135.265843:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:14419:x1875828770188032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788930135.265962:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:14419:x1875828770188032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930135.265968:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788930135.265999:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebc828a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770188032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788930135.269579:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930135.269616:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747123584 00000100:00100000:3.0:1788930135.269626:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747123584 00000100:00100000:3.0:1788930135.269674:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 114 00000100:00100000:3.0:1788930135.269684:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+12:13774:x1875828747123584:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000040:00080000:1.0:1788930135.270505:0:16608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:3.0:1788930135.271471:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+12:13774:x1875828747123584:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 1782us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930135.271491:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 114 00000020:01000000:3.0:1788930135.271619:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788930135.271645:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788930135.271655:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.271666:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930135.271677:0:14419:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788930135.271679:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2ebe0db800 from 10 10000000:01000000:3.0:1788930135.271682:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788930135.271714:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.271721:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.271730:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930135.271881:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770188160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788930135.271931:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930135.271966:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788930135.271983:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770188160 00000100:00100000:3.0:1788930135.271991:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770188160 00000100:00100000:3.0:1788930135.272026:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788930135.272033:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:14419:x1875828770188160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788930135.272045:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930135.272063:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237dd3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237dd37 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.272088:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237dd3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237dd37 expref: 19 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.272100:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237dd3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237dd37 expref: 19 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.272109:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596000, rc 0) 00000100:00100000:3.0:1788930135.272141:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:14419:x1875828770188160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930135.272147:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788930135.272186:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770188160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788930135.272200:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.272208:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930135.272276:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebcb6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770188288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788930135.277144:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930135.277212:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e91701240 going to sleep for 11 seconds 00000100:00100000:3.0:1788930135.277256:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770188288 00000100:00100000:3.0:1788930135.277265:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770188288 00000100:00100000:0.0:1788930135.277572:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930135.277598:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747123712 00000100:00100000:0.0:1788930135.277602:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747123712 00000100:00100000:1.0:1788930135.283493:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788930135.283525:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:14419:x1875828770188288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788930135.284068:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:14419:x1875828770188288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 560us (11764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930135.284078:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788930135.284270:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 117 00000100:00100000:0.0:1788930135.284285:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+12:13774:x1875828747123712:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788930135.284495:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+12:13774:x1875828747123712:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 214us (6924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930135.284502:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 117 00000100:00100000:2.0:1788930135.285439:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebcb6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770188288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788930135.285500:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770188416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788930135.291336:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930135.291396:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788930135.296114:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770188416 00000100:00100000:1.0:1788930135.296135:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770188416 00000100:00100000:1.0:1788930135.296202:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788930135.296213:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:14419:x1875828770188416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788930135.296523:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:14419:x1875828770188416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 311us (5200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930135.296532:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788930135.296807:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:14419:1875828770188416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788930135.301597:0:16610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:3.0:1788930135.304905:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930135.304948:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747123840 00000100:00100000:3.0:1788930135.304958:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747123840 00000100:00100000:3.0:1788930135.305009:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 119 00000100:00100000:3.0:1788930135.305029:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebef2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+12:13774:x1875828747123840:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788930135.305046:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930135.305063:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237dd45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca71640210643 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.305090:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237dd45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210643 expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.305102:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237dd45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210643 expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930135.305111:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597c00, rc 0) 00000100:00100000:3.0:1788930135.305165:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebef2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13774:x1875828747123840:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 137us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930135.305172:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 119 00000100:00100000:3.0:1788930135.308558:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930135.308725:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747123968 00000100:00100000:1.0:1788930135.308749:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747123968 00000100:00100000:1.0:1788930135.308830:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 120 00000100:00100000:1.0:1788930135.308841:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e91368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13774:x1875828747123968:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788930135.309136:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e91368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13774:x1875828747123968:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 297us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930135.309151:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 120 00000020:01000000:0.0:1788930135.313648:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788930135.313685:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788930135.313698:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930135.313724:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930135.314038:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930135.314117:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747124096 00000100:00100000:1.0:1788930135.314127:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747124096 00000100:00100000:1.0:1788930135.314186:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 121 00000100:00100000:1.0:1788930135.314198:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13774:x1875828747124096:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788930135.314455:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9136a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:13774:x1875828747124096:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 260us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930135.314464:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 121 00010000:00010000:3.0:1788930135.387606:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930135.512782:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930135.512910:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747124224 00000100:00100000:1.0:1788930135.512920:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747124224 00000100:00100000:1.0:1788930135.512983:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:1.0:1788930135.513006:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2361:x1875828747124224:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930135.513077:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2361:x1875828747124224:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 86us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930135.513085:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00080000:2.0:1788930135.513179:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930135.521747:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930135.521878:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747124352 00000100:00100000:1.0:1788930135.521888:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747124352 00000100:00100000:1.0:1788930135.521960:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:1.0:1788930135.521978:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2361:x1875828747124352:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930135.522064:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2361:x1875828747124352:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 95us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930135.522076:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00080000:2.0:1788930135.522186:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788930135.528954:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930135.529118:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747124608 00000100:00100000:1.0:1788930135.529129:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747124608 00000100:00100000:1.0:1788930135.529213:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 26 00000100:00100000:1.0:1788930135.529258:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2362:x1875828747124608:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930135.529405:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930135.531525:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930135.531581:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930135.531618:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747124864 00000100:00100000:3.0:1788930135.531627:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747124864 00000100:00100000:3.0:1788930135.531665:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747124480 00000100:00100000:3.0:1788930135.531669:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747124480 00000100:00100000:3.0:1788930135.531697:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747124736 00000100:00100000:3.0:1788930135.531700:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747124736 00000100:00100000:3.0:1788930135.531716:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:1.0:1788930135.531868:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2362:x1875828747124608:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 2613us (3440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930135.531879:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 26 00000100:00080000:1.0:1788930135.531907:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788930135.531911:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788930135.531913:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788930135.532098:0:15108:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788930135.532109:0:15108:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788930135.532635:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2362:x1875828747124864:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930135.532694:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2362:x1875828747124864:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 970us (3289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930135.532702:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:3.0:1788930135.532720:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:3.0:1788930135.533988:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2361:x1875828747124480:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930135.534048:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2361:x1875828747124480:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 71us (2533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930135.537083:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:3.0:1788930135.537122:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:3.0:1788930135.542993:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2361:x1875828747124736:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930135.543189:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2361:x1875828747124736:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 278us (11606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930135.543198:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00010000:00010000:0.0:1788930136.411518:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930137.051489:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770188800:0@lo:400:kworker.0 00000100:00100000:2.0:1788930137.051564:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930137.051639:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788930137.051646:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770188672:0@lo:400:kworker.0 00000100:00100000:2.0:1788930137.051671:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930137.051700:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770189184:0@lo:400:kworker.0 00000100:00100000:2.0:1788930137.051731:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930137.051822:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770188928:0@lo:400:kworker.0 00000100:00100000:0.0:1788930137.051856:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930137.051875:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3311:1875828770188544:0@lo:400:kworker.0 00000100:00100000:1.0:1788930137.051910:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930137.051942:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770189184 00000100:00100000:1.0:1788930137.051945:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770189056:0@lo:400:kworker.0 00000100:00100000:2.0:1788930137.051950:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770189184 00000100:00100000:1.0:1788930137.051964:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930137.051990:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770188928 00000100:00100000:1.0:1788930137.051994:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770188928 00000100:00100000:2.0:1788930137.052010:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770189056 00000100:00100000:2.0:1788930137.052013:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770189056 00000100:00100000:1.0:1788930137.052017:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788930137.052025:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788930137.052025:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770189184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930137.052032:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788930137.052076:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770189184:12345-0@lo:400:kworker.0 Request processed in 51us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930137.052083:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788930137.052098:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788930137.052104:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770188928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930137.052134:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770188928:12345-0@lo:400:kworker.0 Request processed in 30us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930137.052139:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788930137.052140:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770189184:0@lo:400:kworker.0 00000100:00100000:1.0:1788930137.052151:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788930137.052158:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770189056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930137.052197:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770189056:12345-0@lo:400:kworker.0 Request processed in 40us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930137.052203:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788930137.052218:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788930137.052259:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770188928:0@lo:400:kworker.0 00000100:00100000:1.0:1788930137.052285:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770189056:0@lo:400:kworker.0 00000100:00100000:3.0:1788930137.052580:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770188800 00000100:00100000:3.0:1788930137.052585:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770188800 00000100:00100000:3.0:1788930137.052618:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770188672 00000100:00100000:0.0:1788930137.052670:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770188544 00000100:00100000:0.0:1788930137.052675:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770188544 00000100:00100000:0.0:1788930137.052701:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788930137.052708:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3311:x1875828770188544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930137.054486:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788930137.054519:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770188800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930137.054604:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770188800:12345-0@lo:400:kworker.0 Request processed in 105us (3040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930137.054611:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788930137.054658:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770188800:0@lo:400:kworker.0 00000100:00080000:2.0:1788930137.054691:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788930137.054826:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770188672 00000100:00100000:3.0:1788930137.054882:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788930137.054883:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9136ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3311:x1875828770188544:12345-0@lo:400:kworker.0 Request processed in 2174us (2971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930137.054889:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770188672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930137.054892:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788930137.054929:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770188672:12345-0@lo:400:kworker.0 Request processed in 41us (3257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930137.054935:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788930137.054972:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770188672:0@lo:400:kworker.0 00000100:00100000:0.0:1788930137.055258:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788930137.055269:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3311:1875828770188544:0@lo:400:kworker.0 00000100:00100000:0.0:1788930137.055271:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770189312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788930137.055327:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930137.055472:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770189312 00000100:00100000:1.0:1788930137.055478:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770189312 00000100:00100000:1.0:1788930137.055531:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788930137.055539:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770189312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788930137.055566:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788930137.055604:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770189312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930137.055610:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788930137.055755:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770189312:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788930137.057587:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788930137.435436:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930137.840076:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930137.840172:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747124992 00000100:00100000:2.0:1788930137.840182:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747124992 00000100:00100000:2.0:1788930137.840387:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:2.0:1788930137.840399:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+6:14429:x1875828747124992:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788930137.840420:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930137.840444:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237dd4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021064a expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.840638:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237dd53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.840657:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237dd53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.840673:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237dd53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.840716:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237dd5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.840883:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237dd5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.840895:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237dd5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.841214:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237dd61 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.841246:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237dd61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.841253:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237dd61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788930137.841366:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788930137.842255:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788930137.842275:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788930137.842335:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237dd61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842349:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237dd53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842356:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237dd53 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842364:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237dd53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842383:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930137.842388:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237dd53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842396:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237dd53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842409:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:2.0:1788930137.842412:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930137.842418:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237dd53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842424:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237dd53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842440:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237dd5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842446:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237dd5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842451:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237dd5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842456:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930137.842459:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237dd5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842465:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237dd5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842483:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d2e98756400) 00010000:00010000:2.0:1788930137.842496:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930137.842499:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237dd5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842505:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237dd5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842551:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237dd4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021064a expref: 8 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842564:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237dd61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021064a expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.842572:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2e98756800) 00010000:00010000:2.0:1788930137.842574:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788930137.842576:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341400, rc 0) 00000100:00100000:2.0:1788930137.842660:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+7:14429:x1875828747124992:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 2263us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930137.842669:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:0.0:1788930137.846348:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930137.846507:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747125248 00000100:00100000:2.0:1788930137.846518:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747125248 00000100:00100000:2.0:1788930137.846582:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:2.0:1788930137.846592:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+7:14429:x1875828747125248:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788930137.846613:0:16650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930137.846631:0:16650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237dd68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210651 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.847131:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237dd6f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.847148:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237dd6f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.847163:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237dd6f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.847397:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237dd76 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.847407:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.847415:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.848149:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237dd7d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.848162:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237dd7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.848169:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237dd7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930137.848181:0:16650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788930137.848671:0:16650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237dd6f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.848691:0:16650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237dd6f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.848698:0:16650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237dd6f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.848704:0:16650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930137.848709:0:16650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237dd6f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.848717:0:16650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237dd6f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.848952:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2e98756800) 00010000:00010000:2.0:1788930137.848956:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930137.848962:0:16650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237dd6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.848969:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237dd6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.848982:0:16650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.848988:0:16650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237dd76 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.848993:0:16650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237dd76 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.848998:0:16650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930137.849008:0:16650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237dd76 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.849014:0:16650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237dd76 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.849022:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d2e98756900) 00010000:00010000:2.0:1788930137.849024:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930137.849027:0:16650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237dd76 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.849033:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237dd76 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.850001:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237dd68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210651 expref: 10 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.850024:0:16650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237dd7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210651 expref: 9 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.850032:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e98756600) 00010000:00010000:2.0:1788930137.850034:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930137.850037:0:16650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341600, rc 0) 00000100:00100000:2.0:1788930137.850121:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+9:14429:x1875828747125248:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 3529us (3783us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788930137.850131:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:3.0:1788930137.882555:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930137.883415:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747125376 00000100:00100000:1.0:1788930137.883428:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747125376 00000100:00100000:1.0:1788930137.883511:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:1.0:1788930137.883524:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+9:14429:x1875828747125376:12345-192.168.204.40@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788930137.883656:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+9:14429:x1875828747125376:12345-192.168.204.40@tcp:59:lhsmtool_posix.0 Request processed in 135us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930137.883663:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 17 00000040:00080000:2.0:1788930137.949274:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788930137.954990:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930137.955096:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747125504 00000100:00100000:3.0:1788930137.955106:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747125504 00000100:00100000:3.0:1788930137.955165:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:3.0:1788930137.955175:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+9:14435:x1875828747125504:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788930137.955196:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930137.955219:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237dd8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210658 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.955339:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237dd92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.955355:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237dd92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.955367:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237dd92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.955381:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237dd99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.955388:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237dd99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.955394:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237dd99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.955716:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237dd92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.955983:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237dd92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.955991:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237dd92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.955997:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788930137.956003:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237dd92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.956011:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237dd92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.956025:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:3.0:1788930137.956029:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788930137.956034:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237dd92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.956039:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237dd92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.956054:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237dd99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.956060:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237dd99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.956065:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237dd99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.956070:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788930137.956081:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237dd99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.956088:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237dd99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.956096:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d2e838fb200) 00010000:00010000:3.0:1788930137.956098:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788930137.956102:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237dd99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.956107:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237dd99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.956143:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237dd8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210658 expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.956154:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:3.0:1788930137.956156:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788930137.956159:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237dd8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210658 expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930137.956169:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597800, rc 0) 00000100:00100000:3.0:1788930137.956364:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+9:14435:x1875828747125504:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 1188us (1381us total) trans 0 rc 301/301 00000100:00100000:3.0:1788930137.956373:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:0.0:1788930137.978560:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930137.978712:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747125632 00000100:00100000:1.0:1788930137.978723:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747125632 00000100:00100000:1.0:1788930137.978805:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:1.0:1788930137.978816:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0f2435a2-1693-4ef4-8931-95da2710cab3+9:14435:x1875828747125632:12345-192.168.204.40@tcp:700:lfs.0 00000100:00100000:1.0:1788930137.978906:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0f2435a2-1693-4ef4-8931-95da2710cab3+9:14435:x1875828747125632:12345-192.168.204.40@tcp:700:lfs.0 Request processed in 92us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930137.978914:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:0.0:1788930137.986031:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930137.986126:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747125888 00000100:00100000:1.0:1788930137.986136:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747125888 00000100:00100000:1.0:1788930137.986207:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:1.0:1788930137.986219:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+9:14435:x1875828747125888:12345-192.168.204.40@tcp:36:lfs.0 00010000:00010000:1.0:1788930137.986383:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930137.986414:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237dcce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402105d3 expref: 9 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930137.986436:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:1.0:1788930137.986441:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788930137.987068:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930137.987090:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237dd06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210635 expref: 5 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930137.987100:0:14421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930137.987140:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237dd06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210635 expref: 5 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930137.987169:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237dd06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210635 expref: 5 pid: 14424 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930137.987185:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90316300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1875828770189440:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788930137.987561:0:14421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e8c387480 going to sleep for 11 seconds 00000100:00100000:3.0:1788930137.993715:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930137.994435:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90316300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1875828770189440:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788930137.994470:0:14421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930137.994597:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747126016 00000100:00100000:2.0:1788930137.994606:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747126016 00010000:00010000:2.0:1788930137.994661:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237dd06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210635 expref: 6 pid: 14424 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930137.994703:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:2.0:1788930137.994711:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2361:x1875828747126016:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788930137.994735:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788930137.994744:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237dd06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210635 expref: 6 pid: 14424 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.994757:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237dd06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210635 expref: 6 pid: 14424 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.994782:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237dd06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210635 expref: 6 pid: 14424 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.994807:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:2.0:1788930137.994813:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.994822:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.994829:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930137.994855:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788930137.994912:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2361:x1875828747126016:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 200us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930137.994919:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00080000:1.0:1788930137.995907:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788930137.995925:0:14421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930137.995934:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930137.995962:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237dda7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930137.995974:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237dda7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930137.995983:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237dda7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788930138.000355:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788930138.000380:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.000409:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.000417:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.000423:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930138.000429:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.000438:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.000458:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e83038500) 00010000:00010000:1.0:1788930138.000461:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930138.000467:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.000474:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237dda0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788930138.000515:0:14421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014c822b9 reply state 0000000039b459d1 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237dda7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930138.000527:0:14421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788930138.000654:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+10:14435:x1875828747125888:12345-192.168.204.40@tcp:36:lfs.0 Request processed in 14433us (14628us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788930138.000663:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 19 00010000:00010000:1.0:1788930138.008977:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237dda7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.009014:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237dda7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.009022:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237dda7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.009029:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930138.009033:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237dda7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.009042:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237dda7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.009060:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d2e8528d100) 00010000:00010000:1.0:1788930138.009063:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930138.009069:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237dda7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.009075:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237dda7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930138.097995:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930138.098149:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747126144 00000100:00100000:3.0:1788930138.098160:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747126144 00000100:00100000:3.0:1788930138.098308:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:3.0:1788930138.098326:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+9:14443:x1875828747126144:12345-192.168.204.40@tcp:101:lctl.0 00010000:00010000:3.0:1788930138.098354:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930138.098376:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237ddae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021065f expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.098442:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ddb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.098455:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ddb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.098466:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ddb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788930138.098500:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788930138.098504:0:14424:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788930138.098544:0:14424:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ddb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.098570:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237ddae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021065f expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.098590:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ddb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021065f expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.098598:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e838fb200) 00010000:00010000:3.0:1788930138.098600:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788930138.098603:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596800, rc 0) 00000100:00100000:3.0:1788930138.098671:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+10:14443:x1875828747126144:12345-192.168.204.40@tcp:101:lctl.0 Request processed in 347us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930138.098687:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:3.0:1788930138.118969:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930138.119084:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747126272 00000100:00100000:2.0:1788930138.119098:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747126272 00000100:00100000:2.0:1788930138.119266:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:2.0:1788930138.119288:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+5:14444:x1875828747126272:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788930138.119310:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930138.119333:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237ddbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210666 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.119397:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237ddc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.119413:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237ddc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.119424:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237ddc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930138.119459:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788930138.119463:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788930138.119483:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237ddc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.119505:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237ddbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210666 expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.119521:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237ddc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210666 expref: 6 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.119530:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e838fb200) 00010000:00010000:2.0:1788930138.119533:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788930138.119551:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341a00, rc 0) 00000100:00100000:2.0:1788930138.119620:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+6:14444:x1875828747126272:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 345us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930138.119626:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:0.0:1788930138.122660:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930138.122948:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747126400 00000100:00100000:2.0:1788930138.122959:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747126400 00000100:00100000:2.0:1788930138.123065:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00100000:2.0:1788930138.123076:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f457351-9f47-4d69-8728-cf079fbb04a5+6:14444:x1875828747126400:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788930138.123098:0:16650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930138.123118:0:16650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237ddca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021066d expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123193:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ddd1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123208:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ddd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123220:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ddd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123254:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237ddd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123261:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237ddd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123267:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237ddd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123408:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237dddf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123430:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237dddf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123437:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237dddf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930138.123465:0:16650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788930138.123468:0:16650:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788930138.123484:0:16650:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237dddf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123494:0:16650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ddd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123501:0:16650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ddd1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123508:0:16650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ddd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123513:0:16650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930138.123517:0:16650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ddd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123523:0:16650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ddd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123533:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e838fb200) 00010000:00010000:2.0:1788930138.123535:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930138.123540:0:16650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ddd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123557:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340400/0xce4472dd2237ddd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123573:0:16650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237ddd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123579:0:16650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237ddd8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123585:0:16650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237ddd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123590:0:16650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930138.123593:0:16650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237ddd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123599:0:16650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237ddd8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123606:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d2e98756900) 00010000:00010000:2.0:1788930138.123609:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930138.123612:0:16650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237ddd8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123618:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341e00/0xce4472dd2237ddd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123649:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341c00/0xce4472dd2237ddca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021066d expref: 8 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123676:0:16650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237dddf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021066d expref: 7 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.123683:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2e98756400) 00010000:00010000:2.0:1788930138.123686:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788930138.123688:0:16650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341000, rc 0) 00000100:00100000:2.0:1788930138.123821:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f457351-9f47-4d69-8728-cf079fbb04a5+7:14444:x1875828747126400:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 747us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930138.123829:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00100000:0.0:1788930138.127592:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930138.127678:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747126656 00000100:00100000:2.0:1788930138.127688:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747126656 00000100:00100000:2.0:1788930138.127848:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:2.0:1788930138.127861:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+7:14444:x1875828747126656:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788930138.127883:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930138.127904:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237dde6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210674 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930138.127989:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788930138.128102:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237dde6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210674 expref: 9 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.128115:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e838fb200) 00010000:00010000:2.0:1788930138.128129:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788930138.128135:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5340200/0xce4472dd2237dde6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210674 expref: 9 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.128166:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5340200, rc 0) 00000100:00100000:2.0:1788930138.128250:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+8:14444:x1875828747126656:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 365us (640us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788930138.128257:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:3.0:1788930138.130853:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930138.131548:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747126912 00000100:00100000:1.0:1788930138.131559:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747126912 00000100:00100000:1.0:1788930138.131629:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00100000:1.0:1788930138.131642:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+8:14444:x1875828747126912:12345-192.168.204.40@tcp:36:lfs.0 00010000:00010000:1.0:1788930138.131702:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930138.131741:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341000/0xce4472dd2237dddf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021066d expref: 8 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.131778:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2e98756400) 00010000:00010000:1.0:1788930138.131790:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788930138.131823:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237ddf4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.131836:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237ddf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.131845:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237ddf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788930138.132071:0:14421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000557a2024 reply state 000000007ed96de8 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237ddf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930138.132080:0:14421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788930138.132088:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788930138.132378:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+9:14444:x1875828747126912:12345-192.168.204.40@tcp:36:lfs.0 Request processed in 739us (1533us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788930138.132386:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00100000:1.0:1788930138.135197:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930138.135376:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747127168 00000100:00100000:2.0:1788930138.135388:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747127168 00000100:00100000:2.0:1788930138.135445:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:2.0:1788930138.135455:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+9:14444:x1875828747127168:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:2.0:1788930138.135701:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+10:14444:x1875828747127168:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 247us (514us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788930138.135709:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2 00010000:00010000:3.0:1788930138.136340:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237ddf4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.136355:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237ddf4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.136364:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237ddf4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.136370:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788930138.136374:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237ddf4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.136383:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237ddf4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.136399:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2e8528d100) 00010000:00010000:3.0:1788930138.136402:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788930138.136408:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237ddf4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.136414:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237ddf4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930138.138775:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930138.138854:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747127424 00000100:00100000:2.0:1788930138.138864:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747127424 00000100:00100000:2.0:1788930138.138921:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:2.0:1788930138.138931:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+9:14444:x1875828747127424:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788930138.138954:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930138.138973:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237ddfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021067b expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139059:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139074:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139086:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139130:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139139:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139146:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930138.139320:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788930138.139410:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139419:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139426:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139432:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930138.139438:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139445:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139456:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e838fb200) 00010000:00010000:2.0:1788930138.139459:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930138.139463:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139478:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139494:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139501:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139506:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139511:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930138.139513:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139518:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139525:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d2e98756700) 00010000:00010000:2.0:1788930138.139528:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930138.139530:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139535:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139573:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237ddfb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021067b expref: 11 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139594:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e838fb200) 00010000:00010000:2.0:1788930138.139597:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788930138.139600:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341200/0xce4472dd2237ddfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021067b expref: 11 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.139610:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2eb5341200, rc 0) 00000100:00100000:2.0:1788930138.139684:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+10:14444:x1875828747127424:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 754us (920us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788930138.139692:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:3.0:1788930138.144051:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930138.144145:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747127552 00000100:00100000:2.0:1788930138.144155:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747127552 00000100:00100000:2.0:1788930138.144208:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 26 00000100:00100000:2.0:1788930138.144218:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f457351-9f47-4d69-8728-cf079fbb04a5+10:14444:x1875828747127552:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788930138.144293:0:16650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930138.144314:0:16650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784400/0xce4472dd2237de17 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210682 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.144422:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784c00/0xce4472dd2237de1e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.144436:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784c00/0xce4472dd2237de1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.144447:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784c00/0xce4472dd2237de1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930138.144474:0:16650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788930138.144490:0:16650:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788930138.144567:0:16650:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784c00/0xce4472dd2237de1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.144595:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784400/0xce4472dd2237de17 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210682 expref: 12 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.144612:0:16650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784c00/0xce4472dd2237de1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210682 expref: 11 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.144620:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2e98756900) 00010000:00010000:2.0:1788930138.144623:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788930138.144626:0:16650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99784c00, rc 0) 00000100:00100000:2.0:1788930138.144682:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f457351-9f47-4d69-8728-cf079fbb04a5+11:14444:x1875828747127552:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 466us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930138.144689:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 26 00000100:00100000:1.0:1788930138.149043:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930138.149127:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747127680 00000100:00100000:2.0:1788930138.149138:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747127680 00000100:00100000:2.0:1788930138.149205:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:2.0:1788930138.149218:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+11:14444:x1875828747127680:12345-192.168.204.40@tcp:37:lfs.0 00000100:00100000:2.0:1788930138.153932:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+11:14444:x1875828747127680:12345-192.168.204.40@tcp:37:lfs.0 Request processed in 4705us (4887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930138.153948:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:3.0:1788930138.158286:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930138.158402:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747127936 00000100:00100000:1.0:1788930138.158411:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747127936 00000100:00100000:1.0:1788930138.158481:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:1.0:1788930138.158493:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e83ca2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+11:14444:x1875828747127936:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:1.0:1788930138.158730:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e83ca2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+12:14444:x1875828747127936:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 239us (463us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788930138.158761:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:1.0:1788930138.207738:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930138.207848:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747128064 00000100:00100000:3.0:1788930138.207874:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747128064 00000100:00100000:3.0:1788930138.207975:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 27 00000100:00100000:3.0:1788930138.207986:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+10:14450:x1875828747128064:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1788930138.208006:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930138.208027:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210689 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208093:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208108:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208131:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208146:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208152:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208159:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208355:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237de3a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208365:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237de3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208372:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237de3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788930138.208413:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788930138.208417:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788930138.208459:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237de3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208472:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208479:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de2c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208486:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208493:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788930138.208496:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208503:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208514:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e838fb200) 00010000:00010000:3.0:1788930138.208517:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788930138.208523:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208530:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208545:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208564:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208570:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208576:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788930138.208579:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208585:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208593:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d2e838fb800) 00010000:00010000:3.0:1788930138.208595:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788930138.208598:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208603:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208633:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210689 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208645:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237de3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210689 expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.208652:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2e98756900) 00010000:00010000:3.0:1788930138.208655:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788930138.208662:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596a00, rc 0) 00000100:00100000:3.0:1788930138.208782:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+11:14450:x1875828747128064:12345-192.168.204.40@tcp:101:bash.0 Request processed in 796us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930138.208790:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 27 00000100:00100000:0.0:1788930138.212972:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930138.213126:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747128320 00000100:00100000:2.0:1788930138.213136:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747128320 00000100:00100000:2.0:1788930138.213201:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 28 00000100:00100000:2.0:1788930138.213213:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+11:14450:x1875828747128320:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:2.0:1788930138.213292:0:16650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930138.213320:0:16650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784400/0xce4472dd2237de41 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210690 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.213449:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.213466:0:16650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784c00/0xce4472dd2237de1e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210682 expref: 11 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.213475:0:16650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.213510:0:16650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784c00/0xce4472dd2237de1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210682 expref: 11 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.213524:0:16650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784c00/0xce4472dd2237de1e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210682 expref: 11 pid: 16650 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930138.213537:0:16650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16650:1875828770189568:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788930138.213630:0:16650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788930138.219923:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930138.220152:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747128448 00000100:00100000:3.0:1788930138.220163:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747128448 00010000:00010000:3.0:1788930138.220210:0:14409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784c00/0xce4472dd2237de1e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210682 expref: 12 pid: 16650 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930138.220297:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:3.0:1788930138.220307:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+12:2360:x1875828747128448:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788930138.220323:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788930138.220329:0:14409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784c00/0xce4472dd2237de1e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210682 expref: 12 pid: 16650 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.220341:0:14409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784c00/0xce4472dd2237de1e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210682 expref: 12 pid: 16650 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.220362:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2e98756900) 00010000:00010000:3.0:1788930138.220367:0:14409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.220376:0:14409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.220383:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.220400:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788930138.220457:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+12:2360:x1875828747128448:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 151us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930138.220464:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00010000:00010000:2.0:1788930138.220775:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784c00/0xce4472dd2237de1e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210682 expref: 11 pid: 16650 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930138.220795:0:16650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16650:1875828770189568:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788930138.220827:0:16650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.220844:0:16650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.220850:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.220874:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de4f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.220883:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.220890:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.221889:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237de56 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.221903:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237de56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.221912:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237de56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930138.221923:0:16650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788930138.221951:0:16650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.221958:0:16650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.221965:0:16650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.221977:0:16650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930138.221981:0:16650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.221990:0:16650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.222001:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2e98756900) 00010000:00010000:2.0:1788930138.222006:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930138.222010:0:16650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.222016:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237de48 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788930138.222030:0:16650:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df35980d reply state 000000009ecf32f9 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930138.222039:0:16650:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788930138.222077:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784400/0xce4472dd2237de41 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210690 expref: 14 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.222092:0:16650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237de56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210690 expref: 13 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.222099:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788930138.222102:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788930138.222104:0:16650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99785a00, rc 0) 00000100:00100000:2.0:1788930138.222183:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+14:14450:x1875828747128320:12345-192.168.204.40@tcp:101:bash.0 Request processed in 8971us (9222us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788930138.222196:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 28 00010000:00010000:0.0:1788930138.228313:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.228334:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de4f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.228342:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.228348:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930138.228352:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.228360:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de4f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.228387:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2e98756700) 00010000:00010000:0.0:1788930138.228390:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788930138.228395:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de4f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.228401:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785600/0xce4472dd2237de4f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930138.244267:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930138.244483:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747128576 00000100:00100000:3.0:1788930138.244493:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747128576 00000100:00100000:3.0:1788930138.244560:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 29 00000100:00100000:3.0:1788930138.244571:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+13:14450:x1875828747128576:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1788930138.244598:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930138.244621:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de64 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210697 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.244694:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de6b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.244711:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.244728:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788930138.244766:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788930138.244771:0:14424:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788930138.244790:0:14424:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.244812:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.244839:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de64 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210697 expref: 15 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.244876:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210697 expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.244885:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788930138.244888:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788930138.244891:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597400, rc 0) 00000100:00100000:3.0:1788930138.244955:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+14:14450:x1875828747128576:12345-192.168.204.40@tcp:101:bash.0 Request processed in 386us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930138.244963:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 29 00000100:00100000:1.0:1788930138.248015:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930138.248115:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747128832 00000100:00100000:0.0:1788930138.248127:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747128832 00000100:00100000:0.0:1788930138.248192:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:0.0:1788930138.248204:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+14:14450:x1875828747128832:12345-192.168.204.40@tcp:35:bash.0 00000100:00100000:0.0:1788930138.248933:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+15:14450:x1875828747128832:12345-192.168.204.40@tcp:35:bash.0 Request processed in 728us (925us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788930138.248960:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:1.0:1788930138.364642:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930138.365010:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747129088 00000100:00100000:2.0:1788930138.365022:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747129088 00000100:00100000:2.0:1788930138.365211:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 30 00000100:00100000:2.0:1788930138.365261:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+15:14460:x1875828747129088:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788930138.365301:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930138.365324:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784400/0xce4472dd2237de72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021069e expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930138.365449:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788930138.365685:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784400/0xce4472dd2237de72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021069e expref: 17 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.365703:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e838fb200) 00010000:00010000:2.0:1788930138.365706:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788930138.365713:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784400/0xce4472dd2237de72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021069e expref: 17 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930138.365741:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99784400, rc 0) 00000100:00100000:2.0:1788930138.365817:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+16:14460:x1875828747129088:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 595us (1258us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788930138.365825:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 30 00000100:00100000:0.0:1788930138.373778:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930138.373984:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747129344 00000100:00100000:3.0:1788930138.373996:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747129344 00000100:00100000:3.0:1788930138.374057:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:3.0:1788930138.374069:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+16:14460:x1875828747129344:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:3.0:1788930138.374368:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+17:14460:x1875828747129344:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 300us (603us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788930138.374377:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:1.0:1788930138.421302:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930138.421408:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747129600 00000100:00100000:3.0:1788930138.421421:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747129600 00000100:00100000:3.0:1788930138.421484:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 31 00000100:00100000:3.0:1788930138.421493:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+17:14463:x1875828747129600:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788930138.421525:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930138.421548:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de80 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402106a5 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.421670:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de87 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.421700:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.421724:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788930138.421738:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788930138.422160:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de80 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106a5 expref: 20 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.422182:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106a5 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.422192:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788930138.422195:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788930138.422200:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597600, rc 0) 00000100:00100000:3.0:1788930138.422347:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+19:14463:x1875828747129600:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 854us (1057us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788930138.422355:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 31 00000100:00100000:1.0:1788930138.430135:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930138.430182:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930138.430344:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747129856 00000100:00100000:0.0:1788930138.430355:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747129856 00000100:00100000:0.0:1788930138.430417:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:0.0:1788930138.430427:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+19:2361:x1875828747129856:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788930138.430442:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930138.430466:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597600/0xce4472dd2237de87 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106a5 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.430487:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:0.0:1788930138.430493:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930138.430573:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+18:2361:x1875828747129856:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 146us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930138.430581:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:3.0:1788930138.430973:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747129728 00000100:00100000:3.0:1788930138.430980:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747129728 00000100:00100000:3.0:1788930138.431023:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 32 00000100:00100000:3.0:1788930138.431031:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+18:14463:x1875828747129728:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:3.0:1788930138.431090:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de95 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.431107:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.431144:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.431171:0:16650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.431177:0:16650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de95 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.431183:0:16650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.431188:0:16650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788930138.431192:0:16650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.431199:0:16650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de95 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.431207:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788930138.431209:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788930138.431213:0:16650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de95 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.431219:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de95 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930138.431313:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+18:14463:x1875828747129728:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 283us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930138.431320:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 32 00000100:00100000:1.0:1788930138.435258:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930138.435589:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747130112 00000100:00100000:3.0:1788930138.435600:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747130112 00000100:00100000:3.0:1788930138.435657:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:3.0:1788930138.435667:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+18:14463:x1875828747130112:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:3.0:1788930138.436597:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+19:14463:x1875828747130112:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 927us (1382us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788930138.436607:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00010000:00010000:0.0:1788930138.460102:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930138.776568:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930138.776802:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747130368 00000100:00100000:3.0:1788930138.776812:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747130368 00000100:00100000:3.0:1788930138.776893:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 33 00000100:00100000:3.0:1788930138.776904:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+19:14494:x1875828747130368:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:3.0:1788930138.776935:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930138.776956:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de9c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402106ac expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.777094:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dea3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.777125:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.777138:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788930138.777150:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788930138.777443:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237de9c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106ac expref: 22 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.777474:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dea3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106ac expref: 21 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.777498:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788930138.777501:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788930138.777504:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597000, rc 0) 00000100:00100000:3.0:1788930138.777585:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+21:14494:x1875828747130368:12345-192.168.204.40@tcp:101:cat.0 Request processed in 675us (1021us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788930138.777593:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 33 00000100:00100000:2.0:1788930138.797172:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930138.797311:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930138.797405:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747130752 00000100:00100000:3.0:1788930138.797418:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747130752 00000100:00100000:3.0:1788930138.797494:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:3.0:1788930138.797505:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+21:2359:x1875828747130752:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788930138.797521:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788930138.797547:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dea3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106ac expref: 21 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.797566:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788930138.797571:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788930138.797647:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+20:2359:x1875828747130752:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 144us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930138.797655:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:1.0:1788930138.797904:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747130624 00000100:00100000:1.0:1788930138.797910:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747130624 00000100:00100000:1.0:1788930138.797949:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:1.0:1788930138.797958:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+20:14494:x1875828747130624:12345-192.168.204.40@tcp:35:cat.0 00000100:00100000:1.0:1788930138.798271:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+21:14494:x1875828747130624:12345-192.168.204.40@tcp:35:cat.0 Request processed in 304us (1100us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788930138.798279:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:1.0:1788930138.913427:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930138.916591:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747131008 00000100:00100000:3.0:1788930138.916614:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747131008 00000100:00100000:3.0:1788930138.916698:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 34 00000100:00100000:3.0:1788930138.916708:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+21:14500:x1875828747131008:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:3.0:1788930138.916736:0:16650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930138.916766:0:16650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237deb1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402106b3 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.916905:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237deb8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.916921:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237deb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.916936:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237deb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788930138.916947:0:16650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788930138.917142:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237deb1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106b3 expref: 24 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.917163:0:16650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237deb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106b3 expref: 23 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930138.917171:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788930138.917174:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788930138.917177:0:16650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597800, rc 0) 00000100:00100000:3.0:1788930138.917312:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+23:14500:x1875828747131008:12345-192.168.204.40@tcp:101:dd.0 Request processed in 605us (3896us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788930138.917320:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 34 00000100:00100000:3.0:1788930138.920393:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930138.921551:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930138.926959:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747131136 00000100:00100000:1.0:1788930138.926979:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747131136 00000100:00100000:1.0:1788930138.927080:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:1.0:1788930138.927092:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc81d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+23:2361:x1875828747131136:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788930138.927344:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930138.927405:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597800/0xce4472dd2237deb8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106b3 expref: 23 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930138.927428:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:1.0:1788930138.927448:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930138.927518:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc81d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+22:2361:x1875828747131136:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 429us (7136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930138.927526:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:0.0:1788930138.928911:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747131392 00000100:00100000:0.0:1788930138.928923:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747131392 00000100:00100000:0.0:1788930138.928971:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 35 00000100:00100000:0.0:1788930138.928979:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+22:14500:x1875828747131392:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:0.0:1788930138.929035:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930138.929059:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597400/0xce4472dd2237de6b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210697 expref: 22 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.929077:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:0.0:1788930138.929093:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788930138.929343:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237dec6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.929358:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237dec6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.929382:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237dec6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788930138.929435:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788930138.929473:0:14424:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bb5b39b reply state 00000000407846da transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237dec6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930138.929482:0:14424:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788930138.929575:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+24:14500:x1875828747131392:12345-192.168.204.40@tcp:36:dd.0 Request processed in 595us (8033us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788930138.929588:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 35 00000020:00080000:0.0:1788930138.929592:0:14424:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788930138.935445:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237dec6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.935527:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237dec6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.935537:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237dec6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.935544:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930138.935549:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237dec6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.935557:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237dec6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.935598:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:0.0:1788930138.935602:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788930138.935607:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237dec6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930138.935614:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8000/0xce4472dd2237dec6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930139.097434:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930139.097662:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747131648 00000100:00100000:1.0:1788930139.097674:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747131648 00000100:00100000:1.0:1788930139.097753:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788930139.097776:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+23:14500:x1875828747131648:12345-192.168.204.40@tcp:35:dd.0 00000100:00100000:1.0:1788930139.098084:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+24:14500:x1875828747131648:12345-192.168.204.40@tcp:35:dd.0 Request processed in 321us (664us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1788930139.098091:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00080000:2.0:1788930139.099006:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930139.101051:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788930139.101076:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770189696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788930139.101154:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930139.101401:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770189696 00000100:00100000:2.0:1788930139.101409:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770189696 00000100:00100000:2.0:1788930139.101493:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788930139.101503:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770189696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788930139.101538:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788930139.101585:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770189696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930139.101592:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788930139.102208:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788930139.102308:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770189696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788930139.483576:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930139.500913:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930139.516801:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747131776 00000100:00100000:2.0:1788930139.516824:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747131776 00000100:00100000:2.0:1788930139.516914:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 36 00000100:00100000:2.0:1788930139.516926:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebcb68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+24:14515:x1875828747131776:12345-192.168.204.40@tcp:101:stat.0 00010000:00010000:2.0:1788930139.516953:0:16650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930139.516977:0:16650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785000/0xce4472dd2237decd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402106ba expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517059:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237ded4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517074:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237ded4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517084:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237ded4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517097:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237dedb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517104:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237dedb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517131:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237dedb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517264:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237dee2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517273:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237dee2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517280:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237dee2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930139.517316:0:16650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788930139.517319:0:16650:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788930139.517361:0:16650:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237dee2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517373:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237dee2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517381:0:16650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237ded4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517387:0:16650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237ded4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517393:0:16650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237ded4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517399:0:16650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930139.517403:0:16650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237ded4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517418:0:16650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237ded4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517430:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2e98756900) 00010000:00010000:2.0:1788930139.517433:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930139.517438:0:16650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237ded4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517445:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237ded4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517460:0:16650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237dedb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517465:0:16650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237dedb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517471:0:16650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237dedb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517476:0:16650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930139.517479:0:16650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237dedb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517485:0:16650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237dedb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517492:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2e98756300) 00010000:00010000:2.0:1788930139.517495:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930139.517498:0:16650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237dedb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517514:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237dedb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517548:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785000/0xce4472dd2237decd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106ba expref: 26 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517564:0:16650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237dee2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106ba expref: 25 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.517571:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788930139.517573:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788930139.517576:0:16650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99785200, rc 0) 00000100:00100000:2.0:1788930139.517662:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebcb68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+25:14515:x1875828747131776:12345-192.168.204.40@tcp:101:stat.0 Request processed in 737us (16769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930139.517671:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 36 00000100:00100000:0.0:1788930139.598154:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930139.598572:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747132032 00000100:00100000:3.0:1788930139.598581:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747132032 00000100:00100000:3.0:1788930139.598643:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 37 00000100:00100000:3.0:1788930139.598654:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+25:14521:x1875828747132032:12345-192.168.204.40@tcp:36:truncate.0 00010000:00010000:3.0:1788930139.598718:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788930139.598759:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237dee2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106ba expref: 25 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930139.598779:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788930139.598784:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788930139.598986:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dee9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930139.599000:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dee9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930139.599010:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dee9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788930139.599660:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1788930139.599706:0:14424:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c151dca1 reply state 00000000435ba1f7 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dee9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930139.599715:0:14424:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788930139.599907:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+27:14521:x1875828747132032:12345-192.168.204.40@tcp:36:truncate.0 Request processed in 1253us (1762us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788930139.599933:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 37 00000020:00080000:3.0:1788930139.599940:0:14424:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788930139.603492:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dee9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930139.603508:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dee9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930139.603516:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dee9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930139.603521:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930139.603526:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dee9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930139.603533:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dee9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930139.603549:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:0.0:1788930139.603552:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788930139.603557:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dee9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930139.603563:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597000/0xce4472dd2237dee9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930139.822030:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930139.822605:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747132160 00000100:00100000:2.0:1788930139.822616:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747132160 00000100:00100000:2.0:1788930139.822684:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 38 00000100:00100000:2.0:1788930139.822704:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+26:14535:x1875828747132160:12345-192.168.204.40@tcp:101:stat.0 00010000:00010000:2.0:1788930139.822728:0:16650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930139.822902:0:16650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785000/0xce4472dd2237def0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402106c1 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.822974:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237def7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.822988:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237def7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823014:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237def7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823032:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237defe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823040:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237defe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823047:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237defe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823255:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785800/0xce4472dd2237df05 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823264:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785800/0xce4472dd2237df05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823271:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785800/0xce4472dd2237df05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930139.823311:0:16650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788930139.823318:0:16650:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788930139.823338:0:16650:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785800/0xce4472dd2237df05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823350:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785800/0xce4472dd2237df05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823357:0:16650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237def7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823483:0:16650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237def7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823490:0:16650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237def7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823496:0:16650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930139.823500:0:16650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237def7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823508:0:16650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237def7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823521:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2e98756900) 00010000:00010000:2.0:1788930139.823524:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930139.823529:0:16650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237def7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823536:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237def7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823550:0:16650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237defe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823556:0:16650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237defe lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823561:0:16650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237defe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823566:0:16650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930139.823576:0:16650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237defe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823583:0:16650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237defe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823591:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2e98756300) 00010000:00010000:2.0:1788930139.823594:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930139.823597:0:16650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237defe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823603:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237defe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823639:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785000/0xce4472dd2237def0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106c1 expref: 28 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823657:0:16650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785800/0xce4472dd2237df05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106c1 expref: 27 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.823664:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788930139.823666:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788930139.823668:0:16650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99785800, rc 0) 00000100:00100000:2.0:1788930139.825035:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+27:14535:x1875828747132160:12345-192.168.204.40@tcp:101:stat.0 Request processed in 2316us (2997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930139.825047:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 38 00000100:00100000:3.0:1788930139.936473:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930139.936692:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747132416 00000100:00100000:2.0:1788930139.936703:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747132416 00000100:00100000:2.0:1788930139.936914:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:2.0:1788930139.936925:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+27:14545:x1875828747132416:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:2.0:1788930139.936961:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930139.936979:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785000/0xce4472dd2237df0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402106c8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930139.937073:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788930139.937325:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785000/0xce4472dd2237df0c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106c8 expref: 29 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.937340:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e838fb200) 00010000:00010000:2.0:1788930139.937343:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788930139.937348:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785000/0xce4472dd2237df0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106c8 expref: 29 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930139.937364:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99785000, rc 0) 00000100:00100000:2.0:1788930139.937648:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+28:14545:x1875828747132416:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 724us (1184us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1788930139.937656:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:1.0:1788930139.942588:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930139.942884:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747132672 00000100:00100000:0.0:1788930139.942895:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747132672 00000100:00100000:0.0:1788930139.942957:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:0.0:1788930139.942967:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e83ca2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+28:14545:x1875828747132672:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:0.0:1788930139.943484:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e83ca2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+29:14545:x1875828747132672:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 515us (904us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788930139.943494:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:0.0:1788930140.054313:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930140.054446:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747132928 00000100:00100000:1.0:1788930140.054456:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747132928 00000100:00100000:1.0:1788930140.054523:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:1.0:1788930140.054535:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+29:14551:x1875828747132928:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1788930140.054561:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930140.054701:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df1a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402106cf expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.054901:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.054916:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237de56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210690 expref: 30 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.054924:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785800/0xce4472dd2237df05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106c1 expref: 30 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.060260:0:14421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.060324:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785800/0xce4472dd2237df05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402106c1 expref: 30 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.060341:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785800/0xce4472dd2237df05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402106c1 expref: 30 pid: 16650 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930140.060358:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1875828770189824:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788930140.060474:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237de56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210690 expref: 30 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.060483:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237de56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210690 expref: 30 pid: 16650 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930140.060492:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1875828770189952:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788930140.060516:0:14421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90286cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788930140.068985:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1875828770189824:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788930140.072005:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1875828770189952:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788930140.072053:0:14421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930140.078874:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930140.078925:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930140.079303:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747133056 00000100:00100000:1.0:1788930140.079316:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747133056 00010000:00010000:1.0:1788930140.079394:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785800/0xce4472dd2237df05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402106c1 expref: 31 pid: 16650 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930140.079434:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747133184 00000100:00100000:1.0:1788930140.079438:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747133184 00010000:00010000:1.0:1788930140.079452:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237de56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210690 expref: 32 pid: 16650 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930140.079468:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:1.0:1788930140.079479:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+32:2359:x1875828747133056:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788930140.079495:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930140.079502:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785800/0xce4472dd2237df05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402106c1 expref: 32 pid: 16650 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.079516:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785800/0xce4472dd2237df05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402106c1 expref: 32 pid: 16650 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.079540:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785800/0xce4472dd2237df05 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402106c1 expref: 32 pid: 16650 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.079560:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:1.0:1788930140.079565:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.079573:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.079580:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930140.079646:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+31:2359:x1875828747133056:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 169us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930140.079659:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:1.0:1788930140.079679:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:1.0:1788930140.079696:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+30:2359:x1875828747133184:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788930140.079704:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930140.079710:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237de56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210690 expref: 30 pid: 16650 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.079719:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237de56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210690 expref: 30 pid: 16650 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.079937:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237de56 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210690 expref: 30 pid: 16650 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.079952:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:1.0:1788930140.079956:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.079964:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.079971:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.080001:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930140.080101:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+29:2359:x1875828747133184:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 405us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930140.080107:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00010000:00010000:1.0:1788930140.080140:0:14421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.080148:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788930140.080169:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1788930140.087514:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df1a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106cf expref: 30 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.087549:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106cf expref: 29 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.087558:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:1.0:1788930140.087561:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788930140.087565:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a74e00, rc 0) 00000100:00100000:1.0:1788930140.087690:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+29:14551:x1875828747132928:12345-192.168.204.40@tcp:101:bash.0 Request processed in 33155us (33390us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1788930140.087709:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:1.0:1788930140.099211:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930140.101340:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747133440 00000100:00100000:3.0:1788930140.101357:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747133440 00000100:00100000:3.0:1788930140.101591:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 41 00000100:00100000:3.0:1788930140.101605:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+29:14551:x1875828747133440:12345-192.168.204.40@tcp:36:bash.0 00010000:00010000:3.0:1788930140.102093:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df2f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.102112:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df2f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.102126:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df2f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788930140.102185:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1788930140.102212:0:14424:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6762850 reply state 00000000db2238d7 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df2f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930140.102267:0:14424:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788930140.102389:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+32:14551:x1875828747133440:12345-192.168.204.40@tcp:36:bash.0 Request processed in 785us (3188us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1788930140.102398:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 41 00000020:00080000:3.0:1788930140.102404:0:14424:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788930140.105924:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00010000:3.0:1788930140.106119:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df2f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.106153:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df2f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.106162:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df2f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.106169:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788930140.106174:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df2f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.106183:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df2f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.106202:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788930140.106205:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788930140.106210:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df2f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.106216:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df2f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930140.106466:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747133568 00000100:00100000:2.0:1788930140.106477:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747133568 00000100:00100000:2.0:1788930140.106581:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 42 00000100:00100000:2.0:1788930140.106592:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+31:14551:x1875828747133568:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:2.0:1788930140.106616:0:16650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930140.106635:0:16650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237df36 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402106d6 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930140.106702:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237df36 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106d6 expref: 32 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930140.106728:0:16650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237df36 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106d6 expref: 32 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930140.106759:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788930140.106762:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788930140.106765:0:16650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99784000, rc 0) 00000100:00100000:2.0:1788930140.106833:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+32:14551:x1875828747133568:12345-192.168.204.40@tcp:101:bash.0 Request processed in 243us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930140.106840:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 42 00000100:00100000:0.0:1788930140.118285:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930140.118948:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747133696 00000100:00100000:2.0:1788930140.118961:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747133696 00000100:00100000:2.0:1788930140.119035:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00100000:2.0:1788930140.119046:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+32:14551:x1875828747133696:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:2.0:1788930140.119067:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930140.119100:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785000/0xce4472dd2237df3d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402106dd expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930140.119214:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237df44 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930140.119277:0:14423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106cf expref: 33 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930140.119287:0:14423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237df44 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930140.119326:0:14423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402106cf expref: 33 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930140.119347:0:14423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402106cf expref: 33 pid: 14421 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930140.119361:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14423:1875828770190080:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788930140.119461:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788930140.127846:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930140.128009:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747133824 00000100:00100000:1.0:1788930140.128033:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747133824 00010000:00010000:1.0:1788930140.128096:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402106cf expref: 34 pid: 14421 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930140.128136:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:1.0:1788930140.128148:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+34:2362:x1875828747133824:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788930140.128164:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930140.128182:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402106cf expref: 34 pid: 14421 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.128195:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402106cf expref: 34 pid: 14421 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.128275:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:1.0:1788930140.128282:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237df44 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.128291:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237df44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.128298:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237df44 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.128322:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930140.128378:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+34:2362:x1875828747133824:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 234us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930140.128386:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00010000:00010000:2.0:1788930140.128908:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237df21 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402106cf expref: 33 pid: 14421 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930140.128924:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14423:1875828770190080:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788930140.128944:0:14423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237df44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930140.128953:0:14423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237df44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930140.128960:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237df44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930140.129004:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788930140.129008:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788930140.129035:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237df44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930140.129065:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785000/0xce4472dd2237df3d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106dd expref: 33 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930140.129174:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237df44 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106dd expref: 32 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930140.129191:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:2.0:1788930140.129194:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788930140.129197:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99785a00, rc 0) 00000100:00100000:2.0:1788930140.129311:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+32:14551:x1875828747133696:12345-192.168.204.40@tcp:101:bash.0 Request processed in 10266us (11098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930140.129318:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00100000:0.0:1788930140.137709:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930140.138172:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747134080 00000100:00100000:3.0:1788930140.138182:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747134080 00000100:00100000:3.0:1788930140.138301:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:3.0:1788930140.138312:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+32:14551:x1875828747134080:12345-192.168.204.40@tcp:103:bash.0 00010000:00010000:3.0:1788930140.138329:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788930140.138353:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785a00/0xce4472dd2237df44 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106dd expref: 32 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.138398:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784000/0xce4472dd2237df36 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106d6 expref: 31 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.138409:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e98756000) 00010000:00010000:3.0:1788930140.138418:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788930140.138488:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc82a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+30:14551:x1875828747134080:12345-192.168.204.40@tcp:103:bash.0 Request processed in 177us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930140.138495:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:3.0:1788930140.141724:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930140.141970:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747134208 00000100:00100000:1.0:1788930140.141981:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747134208 00000100:00100000:1.0:1788930140.142058:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 44 00000100:00100000:1.0:1788930140.142070:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+30:14551:x1875828747134208:12345-192.168.204.40@tcp:58:bash.0 00010000:00010000:1.0:1788930140.142190:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df4b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.142206:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df4b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930140.142282:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df4b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788930140.150678:0:14421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788930140.151194:0:14421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788930140.151491:0:14421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788930140.151704:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+30:14551:x1875828747134208:12345-192.168.204.40@tcp:58:bash.0 Request processed in 9630us (9983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930140.151716:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 44 00000100:00100000:0.0:1788930140.155417:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930140.155558:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747134336 00000100:00100000:3.0:1788930140.155568:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747134336 00000100:00100000:3.0:1788930140.155632:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 45 00000100:00100000:3.0:1788930140.155642:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+30:14551:x1875828747134336:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:3.0:1788930140.155664:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930140.155683:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df52 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402106e4 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.155759:0:14424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df4b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.155771:0:14424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df52 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106e4 expref: 31 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.155793:0:14424:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df4b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.155809:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df52 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106e4 expref: 31 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.155838:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e8528d800) 00010000:00010000:3.0:1788930140.155842:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788930140.155847:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df52 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106e4 expref: 31 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930140.155855:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596200, rc 0) 00000100:00100000:3.0:1788930140.155935:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+31:14551:x1875828747134336:12345-192.168.204.40@tcp:101:bash.0 Request processed in 295us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930140.155942:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 45 00010000:00010000:0.0:1788930140.507558:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930140.635353:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930140.635392:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930140.635414:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930140.635431:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930140.635449:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930140.635486:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930140.635507:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747134720 00000100:00100000:0.0:1788930140.635530:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747134720 00000100:00100000:0.0:1788930140.635837:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747135232 00000100:00100000:0.0:1788930140.635841:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747135232 00000100:00100000:0.0:1788930140.635857:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747134848 00000100:00100000:0.0:1788930140.635859:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747134848 00000100:00100000:0.0:1788930140.635878:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:0.0:1788930140.635887:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2361:x1875828747134720:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788930140.635956:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2361:x1875828747134720:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 69us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930140.635963:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:0.0:1788930140.635982:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:0.0:1788930140.635988:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2361:x1875828747135232:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788930140.636011:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2361:x1875828747135232:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 24us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930140.636017:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:0.0:1788930140.636158:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:0.0:1788930140.636167:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2361:x1875828747134848:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788930140.636194:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2361:x1875828747134848:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 29us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930140.636200:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:2.0:1788930140.636502:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747134976 00000100:00100000:2.0:1788930140.636507:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747134976 00000100:00100000:2.0:1788930140.636555:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747134592 00000100:00100000:2.0:1788930140.636558:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747134592 00000100:00100000:3.0:1788930140.637040:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747134464 00000100:00100000:3.0:1788930140.637046:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747134464 00000100:00100000:3.0:1788930140.637139:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 123 00000100:00100000:3.0:1788930140.637148:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2361:x1875828747134464:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788930140.637195:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930140.637258:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 30 00000100:00100000:2.0:1788930140.637266:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+11:2361:x1875828747134976:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930140.637309:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+11:2361:x1875828747134976:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 43us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930140.637316:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 30 00000100:00100000:2.0:1788930140.637342:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 31 00000100:00100000:2.0:1788930140.637350:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+31:2361:x1875828747134592:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930140.637376:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+31:2361:x1875828747134592:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930140.637382:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 31 00000100:00080000:2.0:1788930140.637413:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788930140.637418:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788930140.637420:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788930140.637430:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747135104 00000100:00100000:2.0:1788930140.637433:0:15107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747135104 00000100:00080000:1.0:1788930140.637467:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788930140.637480:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:2.0:1788930140.637491:0:15107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2361:x1875828747135104:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930140.637534:0:15107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2361:x1875828747135104:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 47us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930140.637541:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:3.0:1788930140.639428:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9136a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2361:x1875828747134464:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 2271us (4086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930140.639440:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 123 00000040:00080000:2.0:1788930141.019650:0:14457:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788930141.019660:0:14457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788930141.019829:0:14457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788930141.019837:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788930141.020026:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14457:1875828770190208:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788930141.020195:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98aeba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788930141.028547:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930141.028665:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747135360 00000100:00100000:0.0:1788930141.028688:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747135360 00000100:00100000:0.0:1788930141.028768:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:0.0:1788930141.028794:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f2435a2-1693-4ef4-8931-95da2710cab3+32:14552:x1875828747135360:12345-192.168.204.40@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788930141.028882:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f2435a2-1693-4ef4-8931-95da2710cab3+32:14552:x1875828747135360:12345-192.168.204.40@tcp:900:lhsmtool_posix.0 Request processed in 91us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930141.028889:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:2.0:1788930141.029017:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14457:1875828770190208:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00080000:1.0:1788930141.029170:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788930141.040030:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930141.040500:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747135488 00000100:00100000:2.0:1788930141.040510:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747135488 00000100:00100000:2.0:1788930141.040581:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 46 00000100:00100000:2.0:1788930141.040592:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+31:14552:x1875828747135488:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788930141.040626:0:14423:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788930141.040748:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+31:14552:x1875828747135488:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 158us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930141.040756:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 46 00000100:00100000:0.0:1788930141.057946:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930141.058188:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747135616 00000100:00100000:1.0:1788930141.058198:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747135616 00000100:00100000:1.0:1788930141.058314:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 47 00000100:00100000:1.0:1788930141.058336:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+31:14552:x1875828747135616:12345-192.168.204.40@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788930141.058416:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237df59 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058434:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237df59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058448:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237df59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058534:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75000/0xce4472dd2237df60 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058543:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75000/0xce4472dd2237df60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058549:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75000/0xce4472dd2237df60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058572:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237df67 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058596:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237df67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058603:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237df67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788930141.058646:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788930141.058651:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788930141.058683:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237df67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058695:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237df59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058702:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237df59 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058710:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237df59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058716:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930141.058721:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237df59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058730:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237df59 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058742:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e98756600) 00010000:00010000:1.0:1788930141.058745:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930141.058750:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237df59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058769:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237df59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058784:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75000/0xce4472dd2237df60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.058791:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75000/0xce4472dd2237df60 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.059024:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75000/0xce4472dd2237df60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.059031:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930141.059034:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75000/0xce4472dd2237df60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.059040:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75000/0xce4472dd2237df60 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.059048:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d2e8528d200) 00010000:00010000:1.0:1788930141.059051:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930141.059054:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75000/0xce4472dd2237df60 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.059060:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75000/0xce4472dd2237df60 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.059079:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237df67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.059085:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237df67 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.059098:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237df67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.059102:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930141.059105:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237df67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.059112:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237df67 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.059120:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e8528d800) 00010000:00010000:1.0:1788930141.059123:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930141.059126:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237df67 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.059131:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237df67 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930141.059277:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+31:14552:x1875828747135616:12345-192.168.204.40@tcp:34:lhsmtool_posix.0 Request processed in 952us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930141.059286:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 47 00000100:00100000:1.0:1788930141.066660:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930141.066841:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747135872 00000100:00100000:2.0:1788930141.066852:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747135872 00000100:00100000:2.0:1788930141.066981:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00100000:2.0:1788930141.066993:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+31:14552:x1875828747135872:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788930141.067017:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930141.067070:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237df6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402106eb expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.067187:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237df75 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.067205:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237df75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.067497:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237df75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930141.067513:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788930141.067614:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237df75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.067622:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237df75 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.067643:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237df75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.067649:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930141.067654:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237df75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.067661:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237df75 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.067737:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e8528d800) 00010000:00010000:2.0:1788930141.067740:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788930141.067746:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237df75 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.067764:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237df75 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.067812:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237df6e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106eb expref: 33 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.067823:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e98756600) 00010000:00010000:2.0:1788930141.067826:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788930141.067829:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784800/0xce4472dd2237df6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106eb expref: 33 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.067839:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99784800, rc 0) 00000100:00100000:2.0:1788930141.068165:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+32:14552:x1875828747135872:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 1173us (1516us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788930141.068173:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00100000:1.0:1788930141.077937:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930141.078295:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747136000 00000100:00100000:0.0:1788930141.078306:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747136000 00000100:00100000:0.0:1788930141.078380:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 49 00000100:00100000:0.0:1788930141.078393:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+32:14552:x1875828747136000:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788930141.078440:0:14421:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788930141.078556:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+32:14552:x1875828747136000:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 165us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930141.078565:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 49 00000100:00100000:1.0:1788930141.086820:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930141.088589:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747136256 00000100:00100000:0.0:1788930141.088607:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747136256 00000100:00100000:0.0:1788930141.088690:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 50 00000100:00100000:0.0:1788930141.088702:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+32:14552:x1875828747136256:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788930141.088725:0:16650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930141.088746:0:16650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9a00/0xce4472dd2237df83 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402106f2 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788930141.089562:0:16650:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1788930141.089571:0:16650:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788930141.089616:0:16650:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788930141.089876:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237df8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.089906:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237df8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.089919:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237df8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.089991:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9a00/0xce4472dd2237df83 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106f2 expref: 35 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.090012:0:16650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237df8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106f2 expref: 34 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.090020:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:0.0:1788930141.090023:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788930141.090026:0:16650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9e00, rc 0) 00000100:00100000:0.0:1788930141.090089:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+34:14552:x1875828747136256:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 1389us (3283us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788930141.090097:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 50 00000100:00100000:1.0:1788930141.100966:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930141.101055:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747136512 00000100:00100000:0.0:1788930141.101065:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747136512 00000100:00100000:0.0:1788930141.101134:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 51 00000100:00100000:0.0:1788930141.101145:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+34:14552:x1875828747136512:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788930141.101202:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930141.101258:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9e00/0xce4472dd2237df8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106f2 expref: 34 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101278:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2e83038000) 00010000:00010000:0.0:1788930141.101304:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788930141.101337:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237df98 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101351:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237df98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101361:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237df98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101412:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237df9f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2b38f18f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101420:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237df9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b38f18f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101427:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237df9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b38f18f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101491:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237df98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101498:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237df98 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101516:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237df98 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101523:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930141.101528:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237df98 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101535:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237df98 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101550:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2e98756900) 00010000:00010000:0.0:1788930141.101553:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788930141.101558:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237df98 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101564:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237df98 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101574:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237df9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b38f18f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101580:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237df9f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b38f18f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101586:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237df9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b38f18f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101591:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930141.101594:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237df9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b38f18f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101600:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237df9f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2b38f18f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101607:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x2b38f18f (ffff8d2e83038200) 00010000:00010000:0.0:1788930141.101609:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788930141.101612:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237df9f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2b38f18f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.101618:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237df9f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2b38f18f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930141.101720:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+33:14552:x1875828747136512:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 576us (763us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788930141.101728:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 51 00000100:00100000:0.0:1788930141.109499:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930141.109569:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747136640 00000100:00100000:2.0:1788930141.109580:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747136640 00000100:00100000:2.0:1788930141.109694:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 52 00000100:00100000:2.0:1788930141.109706:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d867c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+33:14552:x1875828747136640:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788930141.109729:0:16650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930141.109754:0:16650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237dfa6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402106f9 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.109793:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784200/0xce4472dd2237dfad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.109807:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784200/0xce4472dd2237dfad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.109834:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784200/0xce4472dd2237dfad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.109946:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785200/0xce4472dd2237dfa6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106f9 expref: 35 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.109967:0:16650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784200/0xce4472dd2237dfad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106f9 expref: 34 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.109985:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2e98756300) 00010000:00010000:2.0:1788930141.109987:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788930141.109991:0:16650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99784200, rc 0) 00000100:00100000:2.0:1788930141.110067:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d867c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+34:14552:x1875828747136640:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 363us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930141.110075:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 52 00000100:00100000:3.0:1788930141.113323:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930141.120136:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747136896 00000100:00100000:0.0:1788930141.120153:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747136896 00000100:00100000:0.0:1788930141.120352:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 53 00000100:00100000:0.0:1788930141.120364:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+34:14552:x1875828747136896:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788930141.120467:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237dfb4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.120497:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237dfb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.120509:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237dfb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788930141.120954:0:14423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788930141.120965:0:14423:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 526276740916ns, next at 527276738346ns, rc = 0 00000004:00010000:0.0:1788930141.121068:0:14423:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c337498 reply state 00000000f1dec4cf transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237dfb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930141.121079:0:14423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788930141.121185:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+36:14552:x1875828747136896:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 822us (7872us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788930141.121193:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 53 00010000:00010000:0.0:1788930141.123918:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237dfb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.123955:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237dfb4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.123964:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237dfb4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.123970:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930141.123975:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237dfb4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.123983:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237dfb4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.124004:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2e98756300) 00010000:00010000:0.0:1788930141.124007:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788930141.124012:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237dfb4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.124019:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237dfb4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930141.128596:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930141.128745:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747137024 00000100:00100000:3.0:1788930141.128756:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747137024 00000100:00100000:3.0:1788930141.128853:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 54 00000100:00100000:3.0:1788930141.128864:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+35:14552:x1875828747137024:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788930141.128893:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930141.128914:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597200/0xce4472dd2237dfbb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210700 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.129030:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597200/0xce4472dd2237dfbb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210700 expref: 36 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.129047:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597200/0xce4472dd2237dfbb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210700 expref: 36 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.129869:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2e98756300) 00010000:00010000:3.0:1788930141.129873:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788930141.129877:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597200, rc 0) 00000100:00100000:3.0:1788930141.129964:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+36:14552:x1875828747137024:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 1093us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930141.129973:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 54 00000100:00100000:3.0:1788930141.134922:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930141.136588:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747137152 00000100:00100000:2.0:1788930141.136604:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747137152 00000100:00100000:1.0:1788930141.136915:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:1.0:1788930141.137131:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2362:x1875828747137152:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788930141.140249:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2362:x1875828747137152:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 Request processed in 3281us (5293us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788930141.140263:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:2.0:1788930141.151819:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930141.151901:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747137408 00000100:00100000:1.0:1788930141.151911:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747137408 00000100:00100000:1.0:1788930141.151983:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:1.0:1788930141.151995:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+36:14552:x1875828747137408:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788930141.153582:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+37:14552:x1875828747137408:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 1225us (1407us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788930141.153596:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:0.0:1788930141.165873:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930141.166660:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747137664 00000100:00100000:2.0:1788930141.166679:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747137664 00000100:00100000:2.0:1788930141.166736:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 55 00000100:00100000:2.0:1788930141.166747:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d8437b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+37:14552:x1875828747137664:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788930141.166855:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d8437b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+37:14552:x1875828747137664:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 110us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930141.166863:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 55 00000100:00100000:1.0:1788930141.173935:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930141.174011:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747137792 00000100:00100000:3.0:1788930141.174021:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747137792 00000100:00100000:3.0:1788930141.174073:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 56 00000100:00100000:3.0:1788930141.174081:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+37:14552:x1875828747137792:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788930141.174101:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930141.174119:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597e00/0xce4472dd2237dfc2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210707 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.174205:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237dfc9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.174247:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237dfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.174269:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237dfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788930141.174303:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788930141.174323:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237dfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.174350:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597e00/0xce4472dd2237dfc2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210707 expref: 39 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.174368:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237dfc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210707 expref: 38 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.174376:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2e98756300) 00010000:00010000:3.0:1788930141.174379:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788930141.174383:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596c00, rc 0) 00000100:00100000:3.0:1788930141.174841:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+38:14552:x1875828747137792:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 758us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930141.174849:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 56 00000100:00100000:2.0:1788930141.180745:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930141.180834:0:16618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747137920 00000100:00100000:1.0:1788930141.180844:0:16618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747137920 00000100:00100000:1.0:1788930141.180901:0:16618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:1.0:1788930141.180911:0:16618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2361:x1875828747137920:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788930141.180928:0:16618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930141.180948:0:16618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f112db0/0xce4472dd2237dfd0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021070e expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788930141.180984:0:16618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0e85b, blocks: 0x1 00010000:00010000:1.0:1788930141.181004:0:16618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1788930141.181008:0:16618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930141.181017:0:16618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f112db0/0xce4472dd2237dfd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021070e expref: 7 pid: 16618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.181035:0:16618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f112db0/0xce4472dd2237dfd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021070e expref: 7 pid: 16618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.181068:0:16618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a75600, rc 0) 00000100:00100000:1.0:1788930141.181120:0:16618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+7:2361:x1875828747137920:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 211us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930141.181127:0:16618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:3.0:1788930141.186973:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930141.187713:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747138176 00000100:00100000:2.0:1788930141.187726:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747138176 00000100:00100000:2.0:1788930141.187786:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 57 00000100:00100000:2.0:1788930141.187801:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+38:14552:x1875828747138176:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788930141.187916:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+38:14552:x1875828747138176:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 120us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930141.187924:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 57 00000001:00080000:1.0:1788930141.188056:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000100:00100000:3.0:1788930141.190635:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930141.190731:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747138304 00000100:00100000:0.0:1788930141.190742:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747138304 00000100:00100000:0.0:1788930141.190805:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 58 00000100:00100000:0.0:1788930141.190815:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+38:14552:x1875828747138304:12345-192.168.204.40@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788930141.241721:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:2.0:1788930141.241742:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788930141.242289:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+37:14552:x1875828747138304:12345-192.168.204.40@tcp:44:lhsmtool_posix.0 Request processed in 51468us (51655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930141.242301:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 58 00000100:00100000:1.0:1788930141.245269:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770190336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788930141.245509:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930141.245666:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930141.246213:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770190336 00000100:00100000:1.0:1788930141.246309:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770190336 00000100:00100000:1.0:1788930141.246600:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747138432 00000100:00100000:1.0:1788930141.246604:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747138432 00000100:00100000:1.0:1788930141.246640:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788930141.246655:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:1.0:1788930141.246655:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770190336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788930141.246681:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2362:x1875828747138432:12345-192.168.204.40@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788930141.246779:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2362:x1875828747138432:12345-192.168.204.40@tcp:16:lhsmtool_posix.0 Request processed in 112us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930141.246788:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 16 00002000:00010000:1.0:1788930141.246932:0:15108:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788930141.246936:0:15108:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788930141.246938:0:15108:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788930141.246941:0:15108:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788930139 -> 1788930139 00002000:00010000:1.0:1788930141.246944:0:15108:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788930141.246997:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875828770190336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 348us (1488us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788930141.247004:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1788930141.247047:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2eb597f100/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788930141.247060:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770190336:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1788930141.247797:0:16655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000001:00080000:3.0:1788930141.247814:0:16655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00080000:0.0:1788930141.250399:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788930141.255861:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930141.256025:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747138688 00000100:00100000:2.0:1788930141.256039:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747138688 00000100:00100000:2.0:1788930141.256126:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 59 00000100:00100000:2.0:1788930141.256137:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d84378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+13:14552:x1875828747138688:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788930141.256197:0:16650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788930141.256278:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596c00/0xce4472dd2237dfc9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210707 expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.256301:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2e98756300) 00010000:00010000:2.0:1788930141.256307:0:16650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788930141.256340:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237dfd7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.256355:0:16650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237dfd7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.256369:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237dfd7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788930141.256625:0:16650:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007a3b2b3 reply state 00000000ac54c5aa transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237dfd7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930141.256649:0:16650:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788930141.256763:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d84378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+14:14552:x1875828747138688:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 627us (912us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788930141.256771:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 59 00010000:00010000:0.0:1788930141.259118:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237dfd7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.259141:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237dfd7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.259150:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237dfd7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.259156:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930141.259162:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237dfd7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.259173:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237dfd7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.259195:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2e98756300) 00010000:00010000:0.0:1788930141.259198:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788930141.259202:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237dfd7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.259208:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99785400/0xce4472dd2237dfd7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16650 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930141.263182:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930141.263635:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747138816 00000100:00100000:3.0:1788930141.263647:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747138816 00000100:00100000:3.0:1788930141.263845:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:3.0:1788930141.263857:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:14552:x1875828747138816:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788930141.263877:0:15106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930141.263908:0:15106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4b77cb6/0xce4472dd2237dfde lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210715 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.263941:0:15106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f112db0/0xce4472dd2237dfd0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021070e expref: 7 pid: 16618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.263951:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930141.263955:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930141.263960:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4b77cb6/0xce4472dd2237dfde lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210715 expref: 7 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.263999:0:15106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f112db0/0xce4472dd2237dfd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021070e expref: 7 pid: 16618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.264013:0:15106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f112db0/0xce4472dd2237dfd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021070e expref: 7 pid: 16618 timeout: 626 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930141.264027:0:15106:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15106:1875828770190464:192.168.204.40@tcp:104: 00000100:00100000:3.0:1788930141.264116:0:15106:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311000 going to sleep for 11 seconds 00000100:00100000:2.0:1788930141.272674:0:15106:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15106:1875828770190464:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788930141.272717:0:15106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e4b77cb6/0xce4472dd2237dfde lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210715 expref: 7 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930141.272740:0:15106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597a00, rc 0) 00000100:00100000:2.0:1788930141.272825:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+7:14552:x1875828747138816:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 8969us (9660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930141.272835:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:1.0:1788930141.282207:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930141.282394:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747138944 00000100:00100000:0.0:1788930141.282405:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747138944 00010000:00010000:0.0:1788930141.282452:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f112db0/0xce4472dd2237dfd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021070e expref: 7 pid: 16618 timeout: 626 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930141.282514:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:0.0:1788930141.282525:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+7:2362:x1875828747138944:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788930141.282542:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930141.282568:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f112db0/0xce4472dd2237dfd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021070e expref: 7 pid: 16618 timeout: 626 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.282584:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f112db0/0xce4472dd2237dfd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021070e expref: 7 pid: 16618 timeout: 626 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.282609:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f112db0/0xce4472dd2237dfd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021070e expref: 7 pid: 16618 timeout: 626 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.282627:0:14408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930141.282632:0:14408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930141.282639:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4b77cb6/0xce4472dd2237dfde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210715 expref: 6 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.282650:0:14408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4b77cb6/0xce4472dd2237dfde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210715 expref: 6 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.282704:0:14408:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e4b77cb6/0xce4472dd2237dfde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210715 expref: 6 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930141.282732:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14408:1875828770190592:192.168.204.40@tcp:105: 00000100:00100000:0.0:1788930141.282831:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9aebd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788930141.285069:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14408:1875828770190592:192.168.204.40@tcp:105: 00010000:00010000:0.0:1788930141.285098:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930141.285156:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2362:x1875828747138944:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 2631us (2960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930141.285168:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:2.0:1788930141.285753:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930141.285828:0:16618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747139072 00000100:00100000:1.0:1788930141.285837:0:16618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747139072 00000100:00100000:1.0:1788930141.285905:0:16618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:1.0:1788930141.285916:0:16618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2362:x1875828747139072:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788930141.286137:0:16618:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788930141.286142:0:16618:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788930138 00002000:00010000:1.0:1788930141.286145:0:16618:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788930137 00002000:00010000:1.0:1788930141.286148:0:16618:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788930139 -> 1788930138 00002000:00010000:1.0:1788930141.286150:0:16618:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788930141.286194:0:16618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+7:2362:x1875828747139072:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 Request processed in 280us (444us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788930141.286201:0:16618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:1.0:1788930141.289408:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930141.289665:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747139200 00000100:00100000:0.0:1788930141.289678:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747139200 00000100:00100000:0.0:1788930141.289743:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:0.0:1788930141.289755:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+7:2361:x1875828747139200:12345-192.168.204.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788930141.289886:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.289910:0:15108:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4b77cb6/0xce4472dd2237dfde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210715 expref: 7 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.289919:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930141.289924:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788930141.289929:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.289968:0:15108:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e4b77cb6/0xce4472dd2237dfde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210715 expref: 7 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.290005:0:15108:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e4b77cb6/0xce4472dd2237dfde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210715 expref: 7 pid: 15106 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930141.290022:0:15108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15108:1875828770190720:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788930141.290122:0:15108:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9aebd480 going to sleep for 11 seconds 00000100:00100000:1.0:1788930141.292444:0:15108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15108:1875828770190720:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788930141.292479:0:15108:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930141.293831:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930141.293928:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747139328 00000100:00100000:3.0:1788930141.293937:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747139328 00010000:00010000:3.0:1788930141.293978:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e4b77cb6/0xce4472dd2237dfde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210715 expref: 8 pid: 15106 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930141.294027:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:3.0:1788930141.294037:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+8:2362:x1875828747139328:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788930141.294052:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788930141.294081:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e4b77cb6/0xce4472dd2237dfde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210715 expref: 8 pid: 15106 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.294095:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e4b77cb6/0xce4472dd2237dfde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210715 expref: 8 pid: 15106 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.294117:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4b77cb6/0xce4472dd2237dfde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210715 expref: 8 pid: 15106 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.294136:0:14407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788930141.294141:0:14407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788930141.294147:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.294159:0:14407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.294196:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788930141.294261:0:15108:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.294270:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.294295:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930141.294302:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+7:2362:x1875828747139328:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 266us (478us total) trans 0 rc 0/0 00010000:00010000:0.0:1788930141.294304:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930141.294310:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 15 00010000:00010000:0.0:1788930141.294312:0:15108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.294318:0:15108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930141.294322:0:15108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.294345:0:15108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.294358:0:15108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.294365:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000776b96f8/0xce4472dd2237dfe5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930141.294416:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2361:x1875828747139200:12345-192.168.204.40@tcp:1:lhsmtool_posix.0 Request processed in 4665us (5020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930141.294424:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:0.0:1788930141.298339:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930141.298426:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747139584 00000100:00100000:1.0:1788930141.298437:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747139584 00000100:00100000:1.0:1788930141.298505:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 60 00000100:00100000:1.0:1788930141.298516:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+13:14552:x1875828747139584:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788930141.298607:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74600/0xce4472dd2237dfec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.298640:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74600/0xce4472dd2237dfec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.298653:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74600/0xce4472dd2237dfec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.298934:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.298946:0:14424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597200/0xce4472dd2237dfbb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210700 expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.298954:0:14424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.298988:0:14424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597200/0xce4472dd2237dfbb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210700 expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.299002:0:14424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597200/0xce4472dd2237dfbb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210700 expref: 14 pid: 14424 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930141.299014:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14424:1875828770190848:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788930141.299115:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e91701240 going to sleep for 11 seconds 00000100:00100000:0.0:1788930141.302802:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930141.302880:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747139712 00000100:00100000:3.0:1788930141.302890:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747139712 00000100:00100000:1.0:1788930141.302918:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14424:1875828770190848:192.168.204.40@tcp:104: 00010000:00010000:3.0:1788930141.302941:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597200/0xce4472dd2237dfbb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210700 expref: 15 pid: 14424 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.302950:0:14424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930141.302987:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:3.0:1788930141.302997:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc81f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+15:2361:x1875828747139712:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788930141.303010:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788930141.303017:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597200/0xce4472dd2237dfbb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210700 expref: 15 pid: 14424 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.303030:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597200/0xce4472dd2237dfbb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210700 expref: 15 pid: 14424 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.303050:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc597200/0xce4472dd2237dfbb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210700 expref: 15 pid: 14424 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.303077:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2e98756300) 00010000:00010000:3.0:1788930141.303083:0:14408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.303092:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.303100:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.303146:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788930141.303205:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc81f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+14:2361:x1875828747139712:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 207us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930141.303212:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 16 00010000:00010000:1.0:1788930141.304734:0:14424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.304777:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788930141.304979:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1788930141.305135:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1788930141.305205:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1788930141.305332:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14424:1875828770190976:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788930141.305442:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930141.305475:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e915e8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788930141.306250:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770190976 00000100:00100000:3.0:1788930141.306261:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770190976 00000100:00100000:2.0:1788930141.306396:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788930141.306408:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14424:x1875828770190976:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788930141.306512:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14424:x1875828770190976:12345-0@lo:1000:mdt00_002.0 Request processed in 106us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930141.306520:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788930141.306700:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14424:1875828770190976:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788930141.307431:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1788930141.307516:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14424:1875828770191104:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788930141.307566:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930141.307600:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e915e83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788930141.307627:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770191104 00000100:00100000:2.0:1788930141.307634:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770191104 00000100:00100000:2.0:1788930141.307681:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788930141.307690:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14424:x1875828770191104:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788930141.308367:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14424:x1875828770191104:12345-0@lo:1000:mdt00_002.0 Request processed in 675us (798us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788930141.308394:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788930141.311102:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14424:1875828770191104:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788930141.311172:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311194:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311202:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311208:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930141.311242:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311281:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311299:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2e98756300) 00010000:00010000:1.0:1788930141.311302:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788930141.311307:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311313:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dff3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311347:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df4b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311352:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df4b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311357:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df4b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311361:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930141.311364:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df4b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311368:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df4b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311374:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e8528d800) 00010000:00010000:1.0:1788930141.311376:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788930141.311384:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df52 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106e4 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311405:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df52 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106e4 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311415:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df52 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106e4 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.311456:0:14424:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df52 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106e4 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930141.311470:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14424:1875828770191232:192.168.204.40@tcp:105: 00000100:00100000:1.0:1788930141.311571:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e915e83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788930141.340358:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930141.341078:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747139840 00000100:00100000:3.0:1788930141.341091:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747139840 00000100:00100000:3.0:1788930141.341170:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:3.0:1788930141.342147:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+18:14551:x1875828747139840:12345-192.168.204.40@tcp:49:bash.0 00000100:00100000:1.0:1788930141.344539:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14424:1875828770191232:192.168.204.40@tcp:105: 00010000:00010000:1.0:1788930141.344588:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df4b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344599:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237df4b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344645:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dffa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344660:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dffa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344674:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dffa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344685:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dffa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344706:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dffa lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344713:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dffa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344719:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930141.344723:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dffa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344730:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dffa lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344743:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e8528d800) 00010000:00010000:1.0:1788930141.344746:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930141.344751:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dffa lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344757:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237dffa lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344767:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74600/0xce4472dd2237dfec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344773:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74600/0xce4472dd2237dfec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344779:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74600/0xce4472dd2237dfec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344784:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930141.344793:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74600/0xce4472dd2237dfec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344799:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74600/0xce4472dd2237dfec lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344807:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e8528d800) 00010000:00010000:1.0:1788930141.344810:0:14424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788930141.344813:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74600/0xce4472dd2237dfec lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.344819:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74600/0xce4472dd2237dfec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930141.346401:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+18:14552:x1875828747139584:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 47877us (48061us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788930141.346419:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 60 00000020:00080000:1.0:1788930141.346427:0:14424:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788930141.347444:0:14457:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788930141.347455:0:14457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788930141.347517:0:14457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788930141.347526:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788930141.349803:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930141.351009:0:14426:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1788930141.351026:0:14426:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1788930141.352347:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747140096 00000100:00100000:3.0:1788930141.352358:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747140096 00000100:00100000:1.0:1788930141.352525:0:16658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:1.0:1788930141.352543:0:16658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+18:14552:x1875828747140096:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788930141.353286:0:16658:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788930141.353396:0:16658:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1788930141.353441:0:16658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74c00/0xce4472dd2237e001 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.353460:0:16658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74c00/0xce4472dd2237e001 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.353474:0:16658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74c00/0xce4472dd2237e001 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.353494:0:16658:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74c00/0xce4472dd2237e001 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.353501:0:16658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74c00/0xce4472dd2237e001 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.353508:0:16658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74c00/0xce4472dd2237e001 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.353533:0:16658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788930141.353645:0:16658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+20:14552:x1875828747140096:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 1106us (3849us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1788930141.353656:0:16658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000020:00080000:1.0:1788930141.353662:0:16658:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788930141.353675:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+19:14551:x1875828747139840:12345-192.168.204.40@tcp:49:bash.0 Request processed in 12492us (13326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930141.353686:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00010000:00010000:3.0:1788930141.354876:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930141.354891:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74c00/0xce4472dd2237e001 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.354913:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788930141.354917:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74c00/0xce4472dd2237e001 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.354927:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74c00/0xce4472dd2237e001 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.354942:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2e98756300) 00010000:00010000:3.0:1788930141.354945:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788930141.354951:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74c00/0xce4472dd2237e001 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.354977:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74c00/0xce4472dd2237e001 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930141.354994:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930141.354996:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930141.354998:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930141.359209:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930141.359391:0:16618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747140224 00000100:00100000:1.0:1788930141.359404:0:16618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747140224 00000100:00100000:1.0:1788930141.359479:0:16618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:1.0:1788930141.359491:0:16618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+6:14551:x1875828747140224:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1788930141.359513:0:16618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930141.359536:0:16618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5994772/0xce4472dd2237e008 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021071c expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788930141.359565:0:16618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa0e85a, atime: 0x6aa0e859, ctime: 0x6aa0e85a, blocks: 0x1 00010000:00010000:1.0:1788930141.359590:0:16618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1788930141.359596:0:16618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930141.359607:0:16618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5994772/0xce4472dd2237e008 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021071c expref: 7 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.359645:0:16618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5994772/0xce4472dd2237e008 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021071c expref: 7 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.359660:0:16618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a74600, rc 0) 00000100:00100000:1.0:1788930141.359733:0:16618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+7:14551:x1875828747140224:12345-192.168.204.40@tcp:101:bash.0 Request processed in 244us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930141.359742:0:16618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:0.0:1788930141.367126:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930141.367396:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747140480 00000100:00100000:3.0:1788930141.367407:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747140480 00000100:00100000:3.0:1788930141.367467:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:3.0:1788930141.367477:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+19:14551:x1875828747140480:12345-192.168.204.40@tcp:35:bash.0 00000001:00080000:3.0:1788930141.367754:0:14426:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1788930141.367848:0:14426:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1788930141.368068:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+22:14551:x1875828747140480:12345-192.168.204.40@tcp:35:bash.0 Request processed in 591us (953us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1788930141.368077:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00000020:00080000:3.0:1788930141.368082:0:14426:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788930141.484370:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930141.484487:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747140736 00000100:00100000:0.0:1788930141.484499:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747140736 00000100:00100000:0.0:1788930141.484570:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:0.0:1788930141.484581:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+22:14562:x1875828747140736:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788930141.484607:0:16650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930141.484642:0:16650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9a00/0xce4472dd2237e00f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210723 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788930141.484740:0:16650:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788930141.484863:0:16650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9a00/0xce4472dd2237e00f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210723 expref: 24 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.484878:0:16650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e838fb200) 00010000:00010000:0.0:1788930141.484881:0:16650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788930141.484886:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9a00/0xce4472dd2237e00f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210723 expref: 24 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930141.484901:0:16650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9a00, rc 0) 00000100:00100000:0.0:1788930141.484973:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+23:14562:x1875828747140736:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 392us (613us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1788930141.484980:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 61 00000100:00100000:0.0:1788930141.492761:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930141.495892:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747140864 00000100:00100000:1.0:1788930141.495910:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747140864 00000100:00100000:1.0:1788930141.495989:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:1.0:1788930141.496001:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+23:14562:x1875828747140864:12345-192.168.204.40@tcp:34:lfs.0 00010000:00010000:1.0:1788930141.496081:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237e01d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496097:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237e01d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496108:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237e01d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496122:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e024 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496129:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496136:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496402:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e02b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496411:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e02b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496418:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e02b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788930141.496457:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e02b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496470:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237e01d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496478:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237e01d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496484:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237e01d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496489:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930141.496494:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237e01d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496501:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237e01d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496512:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2e98756900) 00010000:00010000:1.0:1788930141.496515:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930141.496520:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237e01d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496533:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75c00/0xce4472dd2237e01d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496545:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496564:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e024 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496571:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e024 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496577:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930141.496580:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e024 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496586:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e024 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496595:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2e8528da00) 00010000:00010000:1.0:1788930141.496597:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930141.496600:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e024 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496606:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e024 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496621:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e02b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496627:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e02b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496640:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e02b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496645:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930141.496648:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e02b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496666:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e02b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496674:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e8528d800) 00010000:00010000:1.0:1788930141.496676:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930141.496679:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e02b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930141.496685:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e02b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930141.496771:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+23:14562:x1875828747140864:12345-192.168.204.40@tcp:34:lfs.0 Request processed in 772us (4021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930141.496779:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 62 00000100:00100000:1.0:1788930141.503838:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930141.504630:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747141120 00000100:00100000:2.0:1788930141.504642:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747141120 00000100:00100000:2.0:1788930141.504700:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:2.0:1788930141.504710:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+23:14562:x1875828747141120:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:2.0:1788930141.504964:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+24:14562:x1875828747141120:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 256us (1136us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788930141.504971:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 15 00010000:00010000:0.0:1788930141.531899:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930142.171602:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770191488:0@lo:400:kworker.0 00000100:00100000:0.0:1788930142.171620:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770191616:0@lo:400:kworker.0 00000100:00100000:2.0:1788930142.171700:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770191360:0@lo:400:kworker.0 00000100:00100000:0.0:1788930142.171762:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930142.171828:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788930142.171835:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770191744:0@lo:400:kworker.0 00000100:00100000:0.0:1788930142.171861:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930142.172093:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770191744 00000100:00100000:0.0:1788930142.172102:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770191744 00000100:00100000:0.0:1788930142.172150:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788930142.172158:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770191744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930142.172251:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770191744:12345-0@lo:400:kworker.0 Request processed in 67us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930142.172275:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788930142.172331:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770191744:0@lo:400:kworker.0 00000100:00100000:0.0:1788930142.172364:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770191616 00000100:00100000:0.0:1788930142.172368:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770191616 00000100:00100000:0.0:1788930142.172529:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788930142.172535:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770191616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930142.172573:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770191616:12345-0@lo:400:kworker.0 Request processed in 38us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930142.172700:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788930142.172722:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788930142.172741:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770191616:0@lo:400:kworker.0 00000100:00100000:1.0:1788930142.172857:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788930142.172868:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770192128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788930142.173018:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930142.173054:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770192128 00000100:00100000:1.0:1788930142.173058:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770192128 00000100:00100000:1.0:1788930142.173093:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788930142.173101:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770192128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788930142.173143:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788930142.173179:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770192128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930142.173186:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788930142.173263:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770192128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788930142.173821:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930142.173860:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770192000:0@lo:400:kworker.0 00000100:00100000:3.0:1788930142.173903:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930142.174065:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930142.174104:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770191872:0@lo:400:kworker.0 00000100:00100000:2.0:1788930142.174128:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930142.174397:0:16618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770191488 00000100:00100000:1.0:1788930142.174405:0:16618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770191488 00000100:00100000:1.0:1788930142.174455:0:16618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788930142.174463:0:16618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875828770191488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930142.174510:0:16618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875828770191488:12345-0@lo:400:kworker.0 Request processed in 48us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930142.174516:0:16618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788930142.174539:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770192000 00000100:00100000:1.0:1788930142.174542:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770192000 00000100:00100000:1.0:1788930142.174585:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770191872 00000100:00100000:1.0:1788930142.174588:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770191872 00000100:00100000:1.0:1788930142.174609:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788930142.174616:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770192000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930142.174645:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770192000:12345-0@lo:400:kworker.0 Request processed in 31us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930142.174651:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788930142.174663:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788930142.174669:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770191872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930142.174694:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770191872:12345-0@lo:400:kworker.0 Request processed in 27us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930142.174700:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788930142.174730:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930142.174866:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770191360 00000100:00100000:3.0:1788930142.174871:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770191360 00000100:00100000:3.0:1788930142.174913:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788930142.174919:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e91369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3308:x1875828770191360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930142.175315:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e91369050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3308:x1875828770191360:12345-0@lo:400:kworker.0 Request processed in 395us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930142.175329:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788930142.175377:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770191488:0@lo:400:kworker.0 00000100:00100000:3.0:1788930142.175390:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770192000:0@lo:400:kworker.0 00000100:00100000:2.0:1788930142.175641:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770191360:0@lo:400:kworker.0 00000100:00100000:2.0:1788930142.175651:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770191872:0@lo:400:kworker.0 00010000:00010000:3.0:1788930142.556358:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788930143.152435:0:16695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1788930143.583405:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930144.221400:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930144.221438:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930144.221476:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747141376 00000100:00100000:0.0:1788930144.221486:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747141376 00000100:00080000:1.0:1788930144.221569:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788930144.222904:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:0.0:1788930144.222922:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+7:2360:x1875828747141376:12345-192.168.204.40@tcp:16:kworker.0 00000100:00100000:0.0:1788930144.223065:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+7:2360:x1875828747141376:12345-192.168.204.40@tcp:16:kworker.0 Request processed in 148us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930144.223086:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:0.0:1788930144.223256:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747141248 00000100:00100000:0.0:1788930144.223263:0:15111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747141248 00002000:00100000:0.0:1788930144.223287:0:15111:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8d2ebbff8700 x1875828747141248/t0(0) o4->0f2435a2-1693-4ef4-8931-95da2710cab3@192.168.204.40@tcp:690/0 lens 504/0 e 0 to 0 dl 1788930155 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788930144.223312:0:15111:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2ebbff8700 with x1875828747141248 ext(0->8) 00002000:00010000:0.0:1788930144.223318:0:15111:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2ebbff8700 00000100:00100000:0.0:1788930144.223334:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:0.0:1788930144.223341:0:15111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+7:2360:x1875828747141248:12345-192.168.204.40@tcp:4:bash.0 00000100:00100000:0.0:1788930144.226213:0:15111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+9:2360:x1875828747141248:12345-192.168.204.40@tcp:4:bash.0 Request processed in 2860us (4762us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788930144.226243:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00002000:00100000:0.0:1788930144.226256:0:15111:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8d2ebbff8700 x1875828747141248/t8589934598(0) o4->0f2435a2-1693-4ef4-8931-95da2710cab3@192.168.204.40@tcp:690/0 lens 504/448 e 0 to 0 dl 1788930155 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788930144.226266:0:15111:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2ebbff8700 with x1875828747141248 ext(0->8) 00002000:00010000:0.0:1788930144.226272:0:15111:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d2ebbff8700 00000100:00100000:1.0:1788930144.239144:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770192256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788930144.239257:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930144.239352:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770192256 00000100:00100000:1.0:1788930144.239361:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770192256 00000100:00100000:1.0:1788930144.239422:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788930144.239431:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875828770192256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788930144.239462:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788930144.239507:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875828770192256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930144.239514:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788930144.239539:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788930144.239576:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770192256:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788930144.605326:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30023 lines, 30023 kept, 0 dropped, 0 bad.